-- Logs begin at Mon 2022-02-28 12:11:50 UTC, end at Mon 2022-02-28 13:24:40 UTC. -- Feb 28 12:43:19.643033 dv-cinder-831202-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 12:43:19.651570 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 12:43:19 2022] *** Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: nodename: dv-cinder-831202-1-iscsi Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: machine: x86_64 Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: clock source: unix Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: pcre jit disabled Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: detected number of CPU cores: 4 Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: current working directory: / Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: detected binary path: /usr/bin/uwsgi-core Feb 28 12:43:19.653567 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: your processes number limit is 47680 Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: your memory page size is 4096 bytes Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: detected max file descriptor number: 2048 Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: lock engine: pthread robust mutexes Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: thunder lock: enabled Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 12:43:19.654179 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 12:43:19.698239 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: Python main interpreter initialized at 0x558ebb8179c0 Feb 28 12:43:19.698239 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: python threads support enabled Feb 28 12:43:19.698239 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: your server socket listen backlog is limited to 100 connections Feb 28 12:43:19.698239 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: your mercy for graceful operations on workers is 90 seconds Feb 28 12:43:19.698576 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 12:43:19.698671 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: *** Operational MODE: preforking *** Feb 28 12:43:19.698939 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: *** uWSGI is running in multiple interpreter mode *** Feb 28 12:43:19.698939 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: spawned uWSGI master process (pid: 79562) Feb 28 12:43:19.699131 dv-cinder-831202-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 12:43:19.700537 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: spawned uWSGI worker 1 (pid: 79575, cores: 1) Feb 28 12:43:19.700537 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: spawned uWSGI worker 2 (pid: 79576, cores: 1) Feb 28 12:43:19.700537 dv-cinder-831202-1-iscsi devstack@keystone.service[79562]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 12:43:25.432267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 12:43:25.432267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: from cryptography.utils import int_from_bytes Feb 28 12:43:25.433039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 12:43:25.433039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: from cryptography.utils import int_from_bytes Feb 28 12:43:25.433443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 12:43:25.433443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: from cryptography.utils import int_from_bytes Feb 28 12:43:25.433544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 12:43:25.433544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: from cryptography.utils import int_from_bytes Feb 28 12:43:25.477642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 12:43:25.477788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 12:43:25.477875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 12:43:25.477965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 12:43:25.478050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] command line args: [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 12:43:25.478128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] command line args: [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 12:43:25.478249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 12:43:25.478333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 12:43:25.478412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ================================================================================ {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 12:43:25.478488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ================================================================================ {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 12:43:25.478665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] admin_token = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.478752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] admin_token = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.478908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] config_dir = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.478987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] config_dir = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] config_source = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] config_source = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] debug = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] debug = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.479940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.480968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_config_append = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_config_append = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_dir = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_dir = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_file = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_file = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.481925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.482947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.483530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.483679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.483783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.483927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.484922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.485673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] publish_errors = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] publish_errors = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.486962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] standard_threads = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] standard_threads = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.487999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] use_journal = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] use_journal = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] use_json = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] use_json = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] use_stderr = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] use_stderr = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] use_syslog = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.488877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] use_syslog = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.489028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.489108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 12:43:25.489279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.489365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.489510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.489587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.489768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.489845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.490966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.491962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.492913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.493969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.494956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.495911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.496854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.497963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.498977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.499879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.500965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.501984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.502924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.503885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.504971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.505942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.506955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.507932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.508858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.509972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.510994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.511920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.512854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.513980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.external = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.external = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.514986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.password = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.password = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] auth.token = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] auth.token = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.515942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.516961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.517920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.518882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.519904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.520888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.521982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522228 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.522948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.523929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.524962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.525908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.526995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.527984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.528943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.529633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.530921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.531888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.532985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.533924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.534958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.535923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.536857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.537998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.538938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.539895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.540999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.541944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.542921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543815 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.543897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.544977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.545063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.545213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.545307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.546843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.547849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] role.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] role.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.548852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] role.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] role.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.549997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550734 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.550965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.551961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.552922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.553894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.554999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.555971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556440 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.556980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.557919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.558869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.559999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.560967 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.connection = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.connection = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.561941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.562971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.563938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.564974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.565744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79575) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 12:43:25.565817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.566040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 12:43:25.566211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 12:43:25.596967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.597172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.597261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.597407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.597492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.597631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.605979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.606252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.634343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.634571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.635053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.635285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.696004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.696134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.745372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.745604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.746452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.746690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.810506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.810730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.810866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.810969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.811825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.812042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.836898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.837895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.838022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.838106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.838253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.838342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.838514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.850012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.850433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.862525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.862759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.862913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.862999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79575) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.863914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.864046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.864262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 12:43:25.880642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.880851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 12:43:25.881025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.881181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.881280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 12:43:25.881386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 12:43:25.881564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.881647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.881770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 12:43:25.881901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.882823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.893646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.893921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.894996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.902357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.902973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.906117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.906395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.906767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.906850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.907880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.908940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.909134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.909409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.909678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.934657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.935504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.936263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.936537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.937104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.937381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.941643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.941923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.942200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.942532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.942811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.943090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.949602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.949817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.950477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.950762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.954822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.955105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.955383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.955688 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.955930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.956014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.956833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.957020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.957294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.957565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.957834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.975421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.975718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.976639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.976913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.980124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.981347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.983733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.984024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.984957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.985252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.988959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.990224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.992629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.993905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:25.996195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.996493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.996773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.997050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.997333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.997490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.997610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.997787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.998071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.998357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.998669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:25.998950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.016791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.017071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.017337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.017606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.018165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.018453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.018721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.018993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.025239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.026697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.026895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.027167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.028413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.028693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.030720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.031007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.031298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.031609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.031900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.032215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.032502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.032795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.033075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.033368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.045258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.045556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.045844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.046121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.046396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.046481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.046668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.046753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.046941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.047026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.047268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.047570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.047846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.048121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.065695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.067001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.068908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.070211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.072388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.073715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.073930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.075262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.075555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.075831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.076111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.077433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.077707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.077986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.185439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.187725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.188479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.190084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.190820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.191108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.191389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.191686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.193233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.193527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.193814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.194092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.201074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.201311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.202192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.203960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.204250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.204529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.209818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79575) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.210095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.210369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.210644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.210918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.211187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.211489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.211760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 12:43:26.212395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.212944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79575) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.213888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.214156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.214422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.214794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.215075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.215341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.215640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.215915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 12:43:26.250743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558ebb8179c0 pid: 79575 (default app) Feb 28 12:43:26.253240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558ebb8179c0 pid: 79576 (default app) Feb 28 12:43:26.254129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112dcd-1beb-4f6c-bfed-27c2e67dd04f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:26.254421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112dcd-1beb-4f6c-bfed-27c2e67dd04f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:26.254699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112dcd-1beb-4f6c-bfed-27c2e67dd04f None None] PATH_INFO: `/v3` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:26.258871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Feb 28 12:43:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:35.475198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:35.475800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:35.475893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:35.480824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:35.485957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:35.486363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:35.486514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:35.515634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG oslo_db.sqlalchemy.engines [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79575) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 12:43:35.698983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG passlib.handlers.bcrypt [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79575) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 12:43:35.699409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG passlib.handlers.bcrypt [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79575) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 12:43:35.754660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:35.756257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:35.880576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 28 12:43:36.022923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:36.056449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG oslo_db.sqlalchemy.engines [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 12:43:36.183650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3f74-678e-4a48-b2a3-021733452a33 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:36.187926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:36.188575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:36.188861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:36.189139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:36.198784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:36.248576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.common.rbac_enforcer.enforcer [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 12:43:36.248919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19594659-c493-4130-906e-f90fc3cc7c49 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:36.258100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Feb 28 12:43:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 12:43:36.264250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:36.279144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193b9a8-db1d-417b-8e89-1062cce07d00 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:36.284247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:36.285355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:36.285648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:36.285930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] PATH_INFO: `/v3/projects/a00bab95afbd472db33af396a6aecd67` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:36.287423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] RBAC: Authorizing `identity:get_project(project_id=a00bab95afbd472db33af396a6aecd67)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:36.339172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 12:43:36.339537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85316-9d8d-4e82-8ae7-7b9631f7cb14 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:36.344740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Feb 28 12:43:36 2022] GET /identity/v3/projects/a00bab95afbd472db33af396a6aecd67 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:38.588860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662412b6-20e5-4af3-bb79-7fafd96701bd None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:38.589388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662412b6-20e5-4af3-bb79-7fafd96701bd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:38.589388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662412b6-20e5-4af3-bb79-7fafd96701bd None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:38.594013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:38.599387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:38.599822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:38.599968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:38.618616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:38.620156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:38.628494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 12:43:38.650851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662412b6-20e5-4af3-bb79-7fafd96701bd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:38.662472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662412b6-20e5-4af3-bb79-7fafd96701bd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:38.666597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:38.667206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:38.667506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:38.667785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:38.675775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:38.677539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2b5d-d701-4327-a916-8ee61a8f4533 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:38.685956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Feb 28 12:43:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 12:43:38.691522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:38.700320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3a70-5825-45ce-9eb1-1a12ea6a79ee None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:38.704635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:38.705477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:38.705760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:38.706034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:38.707489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:38.709312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd317d4b-b563-4bcb-bc02-927415ca3137 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:38.710828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Feb 28 12:43:38 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:41.036864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201f5-2141-4ec8-ab25-d2e8aba92320 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.037384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201f5-2141-4ec8-ab25-d2e8aba92320 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.037477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201f5-2141-4ec8-ab25-d2e8aba92320 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.039144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:43:41.044329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317742a-f405-4895-a467-739602530daf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.044721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317742a-f405-4895-a467-739602530daf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.044893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317742a-f405-4895-a467-739602530daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.061201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-7317742a-f405-4895-a467-739602530daf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:41.062370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7317742a-f405-4895-a467-739602530daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:41.068366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fd4b-01f2-483d-912f-79a2ac621568 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.068672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fd4b-01f2-483d-912f-79a2ac621568 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.068926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fd4b-01f2-483d-912f-79a2ac621568 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.070613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:43:41.075904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.076194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.076471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.117161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG passlib.handlers.bcrypt [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79576) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 12:43:41.117574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG passlib.handlers.bcrypt [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79576) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 12:43:41.139944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:41.162832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317742a-f405-4895-a467-739602530daf None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.169225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:41.170796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:41.256271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317742a-f405-4895-a467-739602530daf None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.265632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:43:41.288825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.289067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.289625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.289910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.290187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.301617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:41.308615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:43:41.314523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:43:41.315511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.384518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8366cd-5065-470f-9d59-7cfc2a44931d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.406145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15983f-d57c-4eae-bd9a-123a116fad93 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.416685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.417575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.417868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.418152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.439542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.440190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.440484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.440756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.441508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:41.441817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.443203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.454682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:41.460431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.484351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.485935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.552507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677544f-9f31-4125-bc3e-e0a61b93320a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.576142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:43:41.582073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.584457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.585315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.585598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.585875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.587069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.588557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.590142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:41.595967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.673573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38305a9-1e4e-4d59-8558-3aaf2bf8183e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.686719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e697ea-2df9-4f37-9611-d48cb461f382 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.705377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.706169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.706452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.706728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.718496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.719893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.720180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.720453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.721617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.723056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.724651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:41.725239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.726801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.730230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.743711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:43:41.744930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:43:41.750557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:41.821707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27352e-8ec6-4601-bdee-050286d29e74 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.843028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ded81-4dfc-4848-a979-2691d2f5dede None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:41.853831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.854469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.854757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.855033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.855886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.domain.id=default, user.id=ed54666ec9a44289bd042f58137716cd) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:41.856195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.857629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f1da-e08a-41b7-82c5-97ed37a77266 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.864014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/role_assignments?user.id=ed54666ec9a44289bd042f58137716cd&scope.domain.id=default&role.id=02948fe3aa224688a909554882ca78f6 => generated 233 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:41.875638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:41.876326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:41.876613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:41.876887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:41.877631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:41.877939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:41.879414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882610-8efc-4697-9aef-ec8bf76557c1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:41.899120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:44.321602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef28b5-461a-4d49-85e2-7f5f7fd73dc0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.322368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef28b5-461a-4d49-85e2-7f5f7fd73dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.322449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef28b5-461a-4d49-85e2-7f5f7fd73dc0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.324866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:44.330380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.330811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.330978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.352090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:44.353284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:44.447006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:43:44.482176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef28b5-461a-4d49-85e2-7f5f7fd73dc0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:44.608245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef28b5-461a-4d49-85e2-7f5f7fd73dc0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:44.646523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:44.647320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.647633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.647911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.661176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:44.668247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-295d05ab-5f93-476f-ace3-ad109efdcf7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:43:44.669897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 13/24] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:44.675425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:44.786066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6e4c-3e22-454f-b462-6d7c38c032a9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:44.788251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f730-a926-4621-96e7-0b3585771041 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.788538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f730-a926-4621-96e7-0b3585771041 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.788817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f730-a926-4621-96e7-0b3585771041 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.790868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 14/25] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:43:44.796274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.796548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.797200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.829113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:44.830339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:44.853656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:44.854926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:44.854926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:44.855157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:44.855917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:44.856268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:44.858180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:44.880543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 12/26] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:44.885982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.006922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:43:45.007354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f071-ecc1-4724-a397-fa2d96041355 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.050496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.051374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.051688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.051964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.055932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.057407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.059017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 13/28] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:44 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:45.061255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.067492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.245855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617cab9-3c7e-407d-aed3-6abd5d5882c0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.269667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bab791-d223-4888-b480-9f6d9f4381b5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.302242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.303627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.304106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.304547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.326585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.329536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.339443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.340962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.341531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.342038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.344321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.346005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8353c-2c4e-4161-848e-69c5838d40f7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.348128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:45.352724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3e9a-d37c-499e-874c-492904b89287 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.353231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3e9a-d37c-499e-874c-492904b89287 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.353699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3e9a-d37c-499e-874c-492904b89287 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.355805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:45.356791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3e9a-d37c-499e-874c-492904b89287 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.361426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-23a41d0f-a418-41bb-a8fe-cc00d48cbea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:43:45.363202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 16/31] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:45.364615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.365120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.365605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.383175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:45.384720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:45.480818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 17/32] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:45.481985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.540892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3e9a-d37c-499e-874c-492904b89287 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.581653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.583562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.583995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.584423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] PATH_INFO: `/v3/domains/default/users/ed54666ec9a44289bd042f58137716cd/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.586668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ed54666ec9a44289bd042f58137716cd, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.588787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c53738-e47c-4e41-a9bd-f17aa2400563 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.613952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db14827-01d9-46b6-bccd-1c5fa991d00c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.645963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.646608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.646893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.647166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.647920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:45.648226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.649617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.668019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 18/33] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:45.668743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.775862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d00ce7-7bd0-41ed-ba60-71f7e30e69df None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:45.810490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 16/34] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Feb 28 12:43:45 2022] PUT /identity/v3/domains/default/users/ed54666ec9a44289bd042f58137716cd/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:43:45.811048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:45.811850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.812136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.812437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.813291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:45.814226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704eddc-23e9-447f-a433-1dd3235a35e5 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:45.814775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a276b-6ad2-4b8a-ab42-3df148c32d9d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:45.814887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704eddc-23e9-447f-a433-1dd3235a35e5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:45.815356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704eddc-23e9-447f-a433-1dd3235a35e5 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:45.821637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 17/35] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:45.823181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704eddc-23e9-447f-a433-1dd3235a35e5 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:45.944319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704eddc-23e9-447f-a433-1dd3235a35e5 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:46.027013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:46.028561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.028561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.028561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.028987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:46.030595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814ac6-d9af-4f08-b60b-0e5924fefd6f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:46.086539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 19/36] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Feb 28 12:43:45 2022] POST /identity/v3/roles => generated 225 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:46.088309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf2d4-c46a-4908-b150-72488679bd86 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.088609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf2d4-c46a-4908-b150-72488679bd86 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.088894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acf2d4-c46a-4908-b150-72488679bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.108761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b3acf2d4-c46a-4908-b150-72488679bd86 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:46.110937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b3acf2d4-c46a-4908-b150-72488679bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:46.154713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:43:45 2022] POST /identity/v3/projects => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:46.160811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74844-383a-479f-a85c-a2c03c10a8dc None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.162224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74844-383a-479f-a85c-a2c03c10a8dc None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.162996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74844-383a-479f-a85c-a2c03c10a8dc None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.165962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 19/38] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:46.171840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.174207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.174743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.221858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:46.225645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:46.247783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:46.249587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166bf2-dcdf-4a74-b34b-d7f33fd01abf None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.250161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166bf2-dcdf-4a74-b34b-d7f33fd01abf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.251104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166bf2-dcdf-4a74-b34b-d7f33fd01abf None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.254878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 21/40] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:46.261147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.261746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.262252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.294797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:46.297419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:46.358529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:46.360098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:46.404437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:46.404437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:46.468824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3246a2e-6ad3-42e5-bfc9-9dab88cc12ab None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:46.506350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5bb20-71d6-4385-a78e-e1efdc7c8877 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:46.517109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:46.517867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.518228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.518524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.519285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:46.520736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:46.540825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:46.541489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.541776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.542057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.542799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:46.544336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:46.614915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 21/43] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/roles => generated 219 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:46.615804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:46.637971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:46.739783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627199-d980-4f39-a9d3-464ccaa91cc5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:46.781045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:46.781938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.782230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.782513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.783977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:46.785545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66fe37-2feb-4376-926b-1a88daf154d8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:46.787598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 22/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:46.793215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:46.898764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e693fe1-a315-450c-9853-68ceb7a0e2e4 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:46.931463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:46.932156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:46.932445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:46.932784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:46.933499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:46.935012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c170f-a4e9-46bf-9811-0824c0076715 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:47.031075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:43:46 2022] POST /identity/v3/projects => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:48.261936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356e22-b7ab-469c-9675-0813a141e680 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.262418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356e22-b7ab-469c-9675-0813a141e680 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.262418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356e22-b7ab-469c-9675-0813a141e680 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.264294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:48.269666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.270044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.270244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.286629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:48.287842 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:48.351496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:48.374413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356e22-b7ab-469c-9675-0813a141e680 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:48.470157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356e22-b7ab-469c-9675-0813a141e680 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:48.501819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:48.502609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.502896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.503176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.514247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:48.520943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:43:48.522109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:48.527997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:48.621419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf48e7-2649-4157-a039-ef8b404b57b8 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:48.652531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:48.653192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.653481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.653762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.654510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:48.654820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:48.656760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:48.664466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 26/50] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:48.670158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:48.763132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2a07-d858-40e3-850e-fdbfae1b775a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:48.794213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:48.795012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.795297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.795603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.796886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:48.798853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:48.800493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 25/51] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:48 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:48.805917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:48.899967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194bc0c-a141-47ee-8ba7-328dcfbe725c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:48.932056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:48.932847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:48.933138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:48.933422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:48.934590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:48.936094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a5c2-e7dd-430b-8417-828669c32687 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:48.937742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:48.943632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:49.041275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae7b52-193e-49a5-ae35-8df81505a3d7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:49.073305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:49.073949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:49.074237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:49.074516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:49.075340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.domain.id=default, user.id=ed54666ec9a44289bd042f58137716cd) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:49.075681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:49.077143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dc429-101e-4313-87ae-fb3a8db03565 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:49.084918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Feb 28 12:43:48 2022] GET /identity/v3/role_assignments?user.id=ed54666ec9a44289bd042f58137716cd&scope.domain.id=default&role.id=02948fe3aa224688a909554882ca78f6 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:49.347927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055163e-beb9-4d85-908d-bc64a1f0f21e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:49.348399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055163e-beb9-4d85-908d-bc64a1f0f21e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:49.348483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055163e-beb9-4d85-908d-bc64a1f0f21e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:49.350218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 28/54] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:49.355303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:49.355753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:49.355894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:49.372768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:49.373939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:49.435698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:49.458933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055163e-beb9-4d85-908d-bc64a1f0f21e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:49.553791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055163e-beb9-4d85-908d-bc64a1f0f21e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:49.585690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:49.586456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:49.586745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:49.587024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:49.588211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:49.589656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf3875-864d-4f9e-9cd1-a4a6fe35b639 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:49.591206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:49.597048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:49.687685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143258cb-2342-4424-b1c2-60880cca4003 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:49.719448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:49.720115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:49.720399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:49.720677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:49.721399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:49.722852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3002b16-426e-49ce-b39c-b5c9aab330d0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:49.819567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Feb 28 12:43:49 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:52.108221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ec15-ac18-4abc-99f2-01dce6b2b943 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:52.108768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ec15-ac18-4abc-99f2-01dce6b2b943 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:52.108768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ec15-ac18-4abc-99f2-01dce6b2b943 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:52.111088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:52.116316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:52.116727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:52.116891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:52.133868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:52.135059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:52.198817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:52.223075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ec15-ac18-4abc-99f2-01dce6b2b943 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:52.317367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ec15-ac18-4abc-99f2-01dce6b2b943 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:52.349323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:52.350094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:52.350383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:52.350659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:52.351853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:52.353281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd267835-8221-4430-9f7f-79a8f6459948 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:52.354845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:52.360757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:52.451767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb7be0-44f3-4cf6-8243-73be0096ae1f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:52.483182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:52.483868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:52.484759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:52.485058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:52.485767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:52.487235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f043c-8a07-41ed-87b5-454a3128731f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:52.588413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:43:52 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:56.088080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7c11-88c8-41e0-b288-e0b8d095433c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.089105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7c11-88c8-41e0-b288-e0b8d095433c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.089611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7c11-88c8-41e0-b288-e0b8d095433c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.091888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:56.097501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.098319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.098806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.121610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:56.123156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:56.206285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b680a6-91c7-4ba7-a253-dc8d3b9facb8 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.206901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b680a6-91c7-4ba7-a253-dc8d3b9facb8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.207385 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b680a6-91c7-4ba7-a253-dc8d3b9facb8 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.209396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 33/63] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:43:56.215004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78541d5-661f-48b9-b9de-9bfe06a6771c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.215602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78541d5-661f-48b9-b9de-9bfe06a6771c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.216092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78541d5-661f-48b9-b9de-9bfe06a6771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.216830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 31/64] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:56.248528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e78541d5-661f-48b9-b9de-9bfe06a6771c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:56.249758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e78541d5-661f-48b9-b9de-9bfe06a6771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:56.259358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.347580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:43:56.349342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b991-c5eb-46ad-b83d-db40f6f72518 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.349841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b991-c5eb-46ad-b83d-db40f6f72518 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.350320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b991-c5eb-46ad-b83d-db40f6f72518 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.352608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 35/66] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:56.368983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.369570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.370058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.371081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd050c-2d80-4b47-a581-8990c14e6669 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.393339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:56.394875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:56.406570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.407375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.407691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.407976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.420520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:56.430271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:43:56.431802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 32/67] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:56.432732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.471846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:43:56.477262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.553807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ae4c-3691-4b1e-9c16-6d7fa0556d69 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.586382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff4449-ca5d-494a-8d60-d4f15a65988d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.586681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.587494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.587788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.588065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.598307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:56.605589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:43:56.606781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:56.607578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.618673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.619334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.619662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.619946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.620696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:56.621005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:56.622381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e85211-4af1-41f2-8ae8-773e68951d4f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:56.630060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 37/70] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:56.631353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef7c-d343-412a-b04b-80d9d44704d8 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.631665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef7c-d343-412a-b04b-80d9d44704d8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.631945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef7c-d343-412a-b04b-80d9d44704d8 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.633539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 38/71] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:56.635092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117cbb-03be-430a-8376-4ce832a7d92c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.635392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117cbb-03be-430a-8376-4ce832a7d92c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.635706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117cbb-03be-430a-8376-4ce832a7d92c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.637506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 39/72] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:43:56.638112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117cbb-03be-430a-8376-4ce832a7d92c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.708843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd2a3b-243a-4dba-b1b0-0142c0534ff8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.732657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117cbb-03be-430a-8376-4ce832a7d92c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.740939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.741746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.742039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.742325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.752061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:56.759300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:43:56.760806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 34/73] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:56.761290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.763961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.764625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.764920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.765208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.766469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:56.766779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:56.768208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8219-bfb8-4417-a3f2-d0c18192dfda None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:56.776121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 40/74] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:56.777297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e60a-1df5-42d3-b333-4600d8a542f4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.777590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e60a-1df5-42d3-b333-4600d8a542f4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.777872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e60a-1df5-42d3-b333-4600d8a542f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.794527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ce91e60a-1df5-42d3-b333-4600d8a542f4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:56.795741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ce91e60a-1df5-42d3-b333-4600d8a542f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:56.857239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 41/75] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:56.858476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.858773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.859112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.860563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da431d-201f-49e8-a124-30711354f5b2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:56.881579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:43:56.882775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:43:56.893596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:56.894466 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:56.894754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:56.895031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:56.896269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:56.897742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:56.899354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 35/76] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:56.900147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.949132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 42/77] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:43:56.950144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:56.996005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495b973-596e-4190-ad4b-693474d651f9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.028171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.028837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.029127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.029408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.030158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:57.030472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.031980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.039550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.043618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.046615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef6c2b-8aae-4869-959e-53546c4582af None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.079139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.080024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.080314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.080599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.092989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.094485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.096124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 43/79] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:56 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.096875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.135516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340671a-bb79-4ae9-9078-eda79450c9cf None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.166685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.167464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.167784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.168066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.169240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.170689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.172472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 37/80] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.173077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.188533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5190c-ba3a-4a70-b26a-f7d30d57110e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.220584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.221236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.221529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.221818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.265428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ced90c-943a-4af6-ab83-3ada354e7f78 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.283754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.285242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.296302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.297615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.297904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.298188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.307840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:43:57.315208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:43:57.316585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 38/81] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:43:57.317175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.378405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 44/82] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:43:57.379527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.419803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5172-4eac-465a-a6d1-75cfefdfba73 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.451989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.452848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.453165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.453520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.454709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.456218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.457824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 39/83] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.458549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.471381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a79a0-b2fb-44e9-ad6c-28e2a4ef8ae9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.503775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.504417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.504717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.504995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.551067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30fbca-04a1-4a5f-a0d5-68ac954b03e2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.566747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.568243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.583306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.583999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.584294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.584591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.585301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.586761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.659488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 45/84] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:43:57.660356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.685858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 40/85] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:43:57 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:43:57.686686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.761398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35a2b-3502-47f3-80fe-6d85254ea3dc None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.796726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.797660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.797786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.798006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.798730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:57.799073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.800552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.809457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 46/86] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.809633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dd8c2-78d0-4e9d-94e5-8674487c1cb6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.810056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.845506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:57.846391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:57.846679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:57.846989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:57.848262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:57.849770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:57.856519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 41/87] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:57.856519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:57.956252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef1a0-bee4-469a-8977-2a404642be05 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:57.982781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2507c-aada-47e0-85a3-7b347b6fab2a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.005199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.005865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.006155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.006435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.020206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.021349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.021840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.022654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.023375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.024860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.026914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 42/88] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:58.027788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.095377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.097480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.134504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba40e6b-01df-4aea-a278-f63aa0cc6622 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.168810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.169689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.169978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.170949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.171495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.172978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.174761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 43/89] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:58.175439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.203392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 47/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:43:58.204506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.273761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a017-77e8-4607-9ecc-d3842f34795b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.307073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.307262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6b1db-cc57-4618-b9a3-bdb4506bfdd5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.307758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.308040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.308321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.309291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=ed54666ec9a44289bd042f58137716cd) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:58.309510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.310969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.316467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 44/91] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/role_assignments?user.id=ed54666ec9a44289bd042f58137716cd&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:58.317454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.344684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.345834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.346371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.346850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.347949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:58.348504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.350235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.357065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 48/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:58.363495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.423128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88533-f475-46bd-ae12-ba317fe649c9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.460322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.460980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.461267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.461548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.549816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccc85-0acf-41a1-9f9a-775572dbfd48 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.567729 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.569255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.647211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b284a-575b-4965-b995-547b44145827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.648056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b284a-575b-4965-b995-547b44145827 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.648344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b284a-575b-4965-b995-547b44145827 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.648624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b284a-575b-4965-b995-547b44145827 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.652357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b284a-575b-4965-b995-547b44145827 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.653852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b284a-575b-4965-b995-547b44145827 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.655666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:43:58.661414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b284a-575b-4965-b995-547b44145827 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.677338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 45/94] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:43:58.683171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.783410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb742cd-5235-4c2e-8b6d-b447d13d06e2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.818163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.819032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.819316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.819623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] PATH_INFO: `/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.820814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] RBAC: Authorizing `identity:get_project(project_id=c8d2a7b7b19e4d3c927e36499ba63406)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.822547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.824262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 46/95] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:58.836492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:43:58.843985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b284a-575b-4965-b995-547b44145827 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:58.890483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:58.891696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:58.894179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:58.894751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:58.895849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:58.897067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:58.898787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bd4c-5692-4244-b323-419687a3c895 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:58.921262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 50/96] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=6135515bbd37458794241e7a2844577e => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:43:59.002669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8515af-85a2-4b0a-8cb8-73f5215aea35 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:43:59.057200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:43:59.057870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:43:59.058159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:43:59.058444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:43:59.059285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=c8d2a7b7b19e4d3c927e36499ba63406, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:43:59.059633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:43:59.061089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97999b5-aaff-4bf0-9aed-6c2e23bb9356 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:43:59.072029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 47/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:43:58 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=c8d2a7b7b19e4d3c927e36499ba63406&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:00.706905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3686d7-d90b-416c-a700-86b9fdc0d80a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:00.707457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3686d7-d90b-416c-a700-86b9fdc0d80a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:00.707457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3686d7-d90b-416c-a700-86b9fdc0d80a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:00.709414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 51/98] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:00.714522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e32a-8433-4677-a23c-c2138e4c488a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:00.714907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e32a-8433-4677-a23c-c2138e4c488a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:00.715091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e32a-8433-4677-a23c-c2138e4c488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:00.736516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c357e32a-8433-4677-a23c-c2138e4c488a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:00.737735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c357e32a-8433-4677-a23c-c2138e4c488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:00.822353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 48/99] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:00.856190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3686d7-d90b-416c-a700-86b9fdc0d80a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:00.927699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ddb6-9b4c-48e3-a87d-5960df33137e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:00.928032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ddb6-9b4c-48e3-a87d-5960df33137e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:00.928271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ddb6-9b4c-48e3-a87d-5960df33137e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:00.930184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 49/100] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:00.935173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:00.935482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:00.935780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:00.966924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:00.968081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:01.087898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:01.097193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3686d7-d90b-416c-a700-86b9fdc0d80a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:01.129921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:01.155677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:01.156519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.156808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.157092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.174792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:01.181894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:01.183330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 52/102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:01.195950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:01.327142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae29f7-1c6b-4b75-839f-85077ebb7b6c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:01.413299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:01.414109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.414397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.414678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.416018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:01.417492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:01.419281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 51/103] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:01.426205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:01.444388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d67ac-12b3-418f-9826-730ce009c83e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:01.529653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:01.530330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.530628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.532573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.533344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:01.533790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:01.536003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:01.552935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 53/104] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:01.559800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:01.642124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3087b97-3027-4571-b308-0342f93c30c8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:01.712178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:01.712858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.713147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.713428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.714159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:01.715724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:01.760576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42735607-2326-45a6-8808-feae2a647e2e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:01.804420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:01.805352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.805649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.805942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] PATH_INFO: `/v3/users/03429857f64e49c28071727abbef4e08` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.825381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] RBAC: Authorizing `identity:get_user(user_id=03429857f64e49c28071727abbef4e08)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:01.826892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fae1-cdaf-49e3-8e8e-4d57146c2a3c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:01.828674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:01 2022] GET /identity/v3/users/03429857f64e49c28071727abbef4e08 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:01.830180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d032b-9f2f-424c-ae9d-2b8724c894b4 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.831952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d032b-9f2f-424c-ae9d-2b8724c894b4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.833689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d032b-9f2f-424c-ae9d-2b8724c894b4 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.838258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 52/106] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:44:01 2022] POST /identity/v3/projects => generated 302 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:44:01.839034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:01.843911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 55/107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:01.849514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:01.849514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:01.849997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:01.905061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:01.909406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:02.045306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a26bf-f110-4a8f-b5b7-39b68fe1b38f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.049097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 56/108] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:02.078766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.079433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.079750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.080033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.090156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.150685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:02.155585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:02.255496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54186d-e37b-485e-aa53-0128704ab7db None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.257215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 53/109] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:02.262564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.306964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.308184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.308669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.309163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.324711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:02.332689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:02.334141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 57/110] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:02.340632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.364019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e2475-8979-44c4-bf78-daf3378ac357 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.400633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.401503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.401794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.402078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.403299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:02.404818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:02.406618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 54/111] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:02.415497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.465678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1baebd-a33f-47cb-99dd-6126b3380308 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.513750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.514810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.515366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.515904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.516851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:02.517355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:02.518938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e6555-41ee-49b9-a01c-98330869c99b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:02.526312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273dd54-0819-45c2-85e1-94cb2f790f83 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.527821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 58/112] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:02.533660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b572-f9a2-49a0-b485-b20e741f14e2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.534326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b572-f9a2-49a0-b485-b20e741f14e2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.534812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b572-f9a2-49a0-b485-b20e741f14e2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.536811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 59/113] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:02.538291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927bbc-9c41-4a94-9c74-8d033f4269c2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.538776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927bbc-9c41-4a94-9c74-8d033f4269c2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.539250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927bbc-9c41-4a94-9c74-8d033f4269c2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.541048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 60/114] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:02.545756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa927bbc-9c41-4a94-9c74-8d033f4269c2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.565802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.566471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.566762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.567044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.568338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=03429857f64e49c28071727abbef4e08) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:02.568668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:02.570439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11b907-bd82-4e3b-a926-beae38f07031 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:02.576204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 55/115] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/role_assignments?user.id=03429857f64e49c28071727abbef4e08&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:02.577512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68b99-2e3b-4509-9a60-eb54bb099c96 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.577843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68b99-2e3b-4509-9a60-eb54bb099c96 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.578124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68b99-2e3b-4509-9a60-eb54bb099c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.595893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2ab68b99-2e3b-4509-9a60-eb54bb099c96 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:02.597198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2ab68b99-2e3b-4509-9a60-eb54bb099c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:02.682574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa927bbc-9c41-4a94-9c74-8d033f4269c2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.688441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 56/116] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:02.690344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428766f-af88-4f31-b217-276ec2b4d4c2 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.690833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428766f-af88-4f31-b217-276ec2b4d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.691299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428766f-af88-4f31-b217-276ec2b4d4c2 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.693543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 57/117] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:02.700499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.701066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.701528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.723162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:02.726003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:02.746172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:02.747220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.747534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.747874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.749543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:02.751780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2df453-b458-4178-bc2f-e52e809be3d1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:02.753863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 61/118] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:02.755213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:02.755530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:02.755858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:02.774076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:02.775260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:02.818152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 58/119] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:02.819059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.868883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 62/120] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:02.869954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:02.965314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327eeb8-d2eb-408a-8b75-b6c843c58730 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:02.998806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0e46-fa97-448c-9a60-9413cbd51e6d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.005121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.006110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.006566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.006990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.020893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:03.030587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:03.032272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 59/121] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:03.033198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.035510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.036538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.037617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.037617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.038531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.040147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.042041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 63/122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:02 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.042904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.142873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5590c-a2f1-43b6-9dfb-c0a4869f56f0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.145165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440228e9-db24-4c2f-9b45-2ed8091ca932 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.177155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.178059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.178352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.178636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.178940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.180004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.180493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.180970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.189606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:03.192101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:03.197249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:03.198398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 64/123] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:03.199167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.200208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:03.206814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 60/124] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:03.207903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.302958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef4709-402d-4bbb-90be-586a859b15e0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.306786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ec8d-0a46-4f78-a9a5-c72297adb462 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.336985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.337781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.338077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.338364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.339320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:03.339666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.341418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.342223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.343940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.344435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.344914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/1b58e128d5794770a80daa121740fb9e/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.347277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, user_id=1b58e128d5794770a80daa121740fb9e, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.348959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.350760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.351603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.426202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:03 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/1b58e128d5794770a80daa121740fb9e/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:03.427987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.487834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06616f2-fd57-4c35-a552-d443d70cceeb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.525480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.526677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.527197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.527756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.528746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:03.529290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.531537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.540895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.542164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.650009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6ec9-e343-4c18-8be9-2162621a78aa None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.687544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c574f-488e-46f3-ac10-374d0d85cf97 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.695968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.697688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.698224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.699058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.700385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:03.701224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.703857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.717667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.719435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.743943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.745092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.746195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.746811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.750195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.753416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.756526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.758199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:03.903005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d935d27-093c-4a5f-981f-6401269d4652 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.934526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48410d-139d-4b2e-98cf-1c44c8ed2bf0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:03.970928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:03.971827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:03.972115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:03.972392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:03.973578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:03.975099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:03.976792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 68/130] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:03.977549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.000770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.001592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.001885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.002170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.008192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.009690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.011335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 63/131] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:04.012133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.076515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ffd49-8cb5-4743-92d6-b1e5a0cf7fa6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.109361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.110226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.110508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.110785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] PATH_INFO: `/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.112016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=c8d2a7b7b19e4d3c927e36499ba63406)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.113548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.115284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 69/132] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:03 2022] GET /identity/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:04.116067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.214316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c631a8-ee80-48c5-b077-c346bc365ab1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.228418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99baa6-55d0-42ec-947a-e316629d0f0c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.248768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.250248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.250538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.250870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.252251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.253716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.255742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 70/133] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:04 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:04.256492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.316221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.317109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.317406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.317698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.322817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.324354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.326082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 64/134] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:04 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:04.326837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.356303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326035-c2a7-4188-bab7-4db78016c7e5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.397423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.398359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.398618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.398895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] PATH_INFO: `/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406/users/1b58e128d5794770a80daa121740fb9e/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.404802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8d2a7b7b19e4d3c927e36499ba63406, user_id=1b58e128d5794770a80daa121740fb9e, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.406938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.444761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00469f-899b-4baf-9f0b-022d5cd7a871 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.481502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.482433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.482777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.483063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/1b58e128d5794770a80daa121740fb9e/roles/6135515bbd37458794241e7a2844577e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.486196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, user_id=1b58e128d5794770a80daa121740fb9e, role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.487742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa8a3b-d322-4c82-8180-a1fe35d69af0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.518067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 71/135] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:04 2022] PUT /identity/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406/users/1b58e128d5794770a80daa121740fb9e/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:04.518067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:04.567106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 65/136] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:04 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/1b58e128d5794770a80daa121740fb9e/roles/6135515bbd37458794241e7a2844577e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:04.631108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3757ba-5189-477d-bf5f-e1506ff48908 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:04.668533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:04.669458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.669744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.670024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/ed54666ec9a44289bd042f58137716cd/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.673106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, user_id=ed54666ec9a44289bd042f58137716cd, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:04.674709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef1c30-9d55-4bac-8863-f32645152fcf None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:04.750214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 72/137] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:04 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/ed54666ec9a44289bd042f58137716cd/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:04.857203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb5f4-6a6a-4559-ac39-521871929fdf None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.857717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb5f4-6a6a-4559-ac39-521871929fdf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.857816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eb5f4-6a6a-4559-ac39-521871929fdf None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.860004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 66/138] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:04.866723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:04.867135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:04.867318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:04.887205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:04.888361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:04.974139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 73/139] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:05.010593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb5f4-6a6a-4559-ac39-521871929fdf None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:05.129620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eb5f4-6a6a-4559-ac39-521871929fdf None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:05.172093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:05.172899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.173196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.173482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.180211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:05.181708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b5ae-1d44-49fe-b50e-a792f6887084 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:05.183695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:05.191326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:05.245709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b88df-a7fd-4c02-8ec6-02bb16b2871f None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.246006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b88df-a7fd-4c02-8ec6-02bb16b2871f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.246300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b88df-a7fd-4c02-8ec6-02bb16b2871f None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.248245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 68/141] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:05.261312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.261610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.261900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.291657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:05.292887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:05.333864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d22649-bdae-4df7-90be-91792ada28f0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:05.396358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:05.396852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.397145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.397423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.398221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:05.399656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:05.429876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 69/142] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:05.454547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:05.516788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 74/143] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:05 2022] POST /identity/v3/users => generated 283 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:05.596512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa5ff-dcbd-4b83-ae6d-ccfe8e608354 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:05.631525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:05.632359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.632643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.632920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.643788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:05.650805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:05.652011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 70/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:05.657861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:05.774638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579c5b-aefa-4793-a427-557fdaef95fe None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:05.820220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:05.820905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:05.821231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:05.821785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:05.822547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:05.822859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:05.824291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:05.833045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 75/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:05.838502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:05.970220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18772f4d-1c85-4dbb-b9d1-08e3eb799c3a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:06.004900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:06.005784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:06.006077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:06.006364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] PATH_INFO: `/v3/users/03429857f64e49c28071727abbef4e08` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:06.007628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] RBAC: Authorizing `identity:get_user(user_id=03429857f64e49c28071727abbef4e08)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:06.009134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:06.010938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 71/146] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:05 2022] GET /identity/v3/users/03429857f64e49c28071727abbef4e08 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:06.020554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:06.170028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ce0f-ce9e-4f50-8159-cf0d48cdcb80 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:06.217640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:06.218989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:06.219281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:06.219590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:06.220826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:06.222305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59cff5-70b4-4430-82b4-c2d136d22a6b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:06.224062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 76/147] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:06 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:06.230144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:06.346584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e860a-92fb-4e73-862e-ffb23f44bd36 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:06.385999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:06.386914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:06.387209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:06.387509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/03429857f64e49c28071727abbef4e08/roles/2ce0d9c04e294781826bcd37c7b3df4d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:06.389555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, user_id=03429857f64e49c28071727abbef4e08, role_id=2ce0d9c04e294781826bcd37c7b3df4d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:06.391611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5dfa8-222b-4bcb-b9ef-ae52b6c50d6c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:06.511689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 72/148] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:06 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/users/03429857f64e49c28071727abbef4e08/roles/2ce0d9c04e294781826bcd37c7b3df4d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:06.703801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5c3f-38d0-4377-ac98-9b65a2460c98 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:06.704172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5c3f-38d0-4377-ac98-9b65a2460c98 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:06.704380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5c3f-38d0-4377-ac98-9b65a2460c98 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:06.706242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 77/149] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:06.712193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:06.712488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:06.712774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:06.736483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:06.737721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:06.805411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 73/150] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:06.851478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5c3f-38d0-4377-ac98-9b65a2460c98 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:06.983007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5c3f-38d0-4377-ac98-9b65a2460c98 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:07.030025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:07.030912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:07.031155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:07.031437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:07.043171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:07.050739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:07.052744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:07.058173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:07.179904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb732-65f4-444b-b89d-5a6bbb2be700 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:07.219044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:07.219765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:07.220062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:07.220347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:07.221115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:07.221433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:07.222839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:07.232693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:07.238069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:07.347422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0547-5b03-416a-934f-2a75ddc5a723 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:07.393247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:07.394139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:07.394434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:07.394722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:07.396182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:07.397664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:07.399308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:07 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:07.404930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:07.521790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb98e-5fab-4b68-8eba-7214228831b2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:07.558984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:07.559675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:07.559971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:07.560257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:07.654189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:07.656164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:07.776332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 75/154] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:07.782966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:07.949742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f79848-5829-4225-9546-87be8dba3d7a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:07.995054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:07.995961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:07.996254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:07.996534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:07.997797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:07.999364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494a96-3234-44a8-ac1f-41e1d689b21b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:08.001673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:07 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:08.007715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:08.162690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901358d2-9da6-450a-bfb8-3d93b652e222 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:08.207039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:08.208082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:08.208576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:08.209075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:08.210119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:08.210640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:08.212367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cc88c-92a3-4393-a7a8-c95b2352721e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:08.219735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:08 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:08.705642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be33-9b3d-43be-b42e-576011ec2ad2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:08.706145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be33-9b3d-43be-b42e-576011ec2ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:08.706217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435be33-9b3d-43be-b42e-576011ec2ad2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:08.708310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 81/157] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:08.714911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:08.715338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:08.715643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:08.717134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c5c5-22e9-43fb-a965-67bba84f06a5 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:08.717423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c5c5-22e9-43fb-a965-67bba84f06a5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:08.717704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c5c5-22e9-43fb-a965-67bba84f06a5 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:08.720220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 82/158] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:08.727256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:08.727582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:08.727850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:08.756520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:08.757751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:08.777838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:08.779064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:08.885826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 83/159] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:08.899730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 77/160] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:08.925750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:08.973077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.039899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34e26-6a75-4311-940b-0629277ca3e5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.079845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.080651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.080937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.081460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.108390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:09.115396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0ce8aba3-345c-4814-af65-f25a6f068440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:09.116948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 84/161] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:09.118348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b107e-c025-40ae-946f-abcc0e033aaa None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.118639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b107e-c025-40ae-946f-abcc0e033aaa None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.118920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b107e-c025-40ae-946f-abcc0e033aaa None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.125451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 85/162] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:09.129255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b107e-c025-40ae-946f-abcc0e033aaa None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.138461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda47b82-49b1-4cb0-adce-96748f06cb9f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.172684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.174126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.174544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.174954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.185208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:09.192940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-aaa1d3d6-200a-41ba-a344-0436aac0be5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:09.194277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 78/163] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:09.195678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.196122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.196803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.213821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:09.215180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:09.281712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 79/164] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:09.282747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.332163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b107e-c025-40ae-946f-abcc0e033aaa None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.381584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.382602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.383091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.383625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.384601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:09.385112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.386700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.403652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 86/165] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:09.404839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.406160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f50323-89ce-48c2-9f68-3083e3f940a4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.443371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.444450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.444925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.445442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.446697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:09.447195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.448850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.457634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 80/166] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:09.458767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.558796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdd5f2-34b3-4db4-8556-89cfcc50f02d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.578768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf863a4-bdc5-4d15-a695-62a4f9adbbcf None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.600857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.601995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.602438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.602848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] PATH_INFO: `/v3/users/ed54666ec9a44289bd042f58137716cd` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.604263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] RBAC: Authorizing `identity:get_user(user_id=ed54666ec9a44289bd042f58137716cd)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.605860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.607634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 81/167] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/users/ed54666ec9a44289bd042f58137716cd => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:09.608804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.620755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.621689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.622054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.622403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.637661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:09.653388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:09.654820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 87/168] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:09.656371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.711783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84127-5007-4985-9493-77a3ccecd512 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.746018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.747238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.747753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.748221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.749659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.751319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.753151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 82/169] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:09.754148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:09.802359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed33946-63e3-45ec-b078-2fa973fc8940 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.856605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.858310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.859553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.860055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.898733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f80b1-379f-45d1-b767-de8b8bae6857 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:09.955064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:09.956043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:09.956522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:09.956989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:09.957928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:09.958493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.959946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:09.960343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.961423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:09.969962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 83/170] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:09.971212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.065726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 88/171] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:10.066649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.099733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4290eb-c3f4-4c34-9b79-dadacf71ff5f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.134921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.135984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.136465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.136951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.168150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b9ca7-bcd7-4756-a805-27e90c5f026d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.216170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.217312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.217733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.218721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] PATH_INFO: `/v3/users/1b58e128d5794770a80daa121740fb9e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.220169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] RBAC: Authorizing `identity:get_user(user_id=1b58e128d5794770a80daa121740fb9e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.221781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.224623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/users/1b58e128d5794770a80daa121740fb9e => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:10.225580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.227852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.229907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.331885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 84/173] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:10.333086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.432497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91587434-d7f7-45ca-bdb7-aec01622be43 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.455702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc15f7-97ed-4e86-92d6-cf4399ae36f6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.468050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.468994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.469493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.469960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.516777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.517638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.518098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.518511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.524646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.527621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.529765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:10.530980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.542910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.544954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.648152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 85/175] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:10.649325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.681907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a41b-7c0c-4717-9d0a-2228b2590b99 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.744882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.745665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.746105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.746520 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] PATH_INFO: `/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.747819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3f7d0-646a-4a5e-9afe-40b0833885db None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.752225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] RBAC: Authorizing `identity:get_project(project_id=c8d2a7b7b19e4d3c927e36499ba63406)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.753712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.755436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 91/176] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/projects/c8d2a7b7b19e4d3c927e36499ba63406 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:10.756306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.783526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.784541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.785016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.785484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.786522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=ed54666ec9a44289bd042f58137716cd) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:10.787037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.788854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.795095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 86/177] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/role_assignments?user.id=ed54666ec9a44289bd042f58137716cd&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:10.796719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.857179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88ba9-551a-405d-80c6-f5002097ff06 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.900251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.901150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.901436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.901714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.904129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be1df-b72d-4c8d-89b8-e5aef9e45034 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:10.908480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:10.910051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf19d62-1b8e-40af-b04f-3c63b37db5fa None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:10.912350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 92/178] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:10.913736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03387-4802-4fe1-850f-b5ed36bd599e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.914029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03387-4802-4fe1-850f-b5ed36bd599e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.914314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe03387-4802-4fe1-850f-b5ed36bd599e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.916360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 93/179] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:10.923874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03387-4802-4fe1-850f-b5ed36bd599e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:10.996994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:10.997603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:10.997893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:10.998176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:10.999025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=c8d2a7b7b19e4d3c927e36499ba63406, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:10.999997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.001499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b519b-6a74-4d83-99e2-73ce99e263d4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.022185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 87/180] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=c8d2a7b7b19e4d3c927e36499ba63406&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.023774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051768-a609-4863-854f-4e4630a3986c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.024213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051768-a609-4863-854f-4e4630a3986c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.024638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051768-a609-4863-854f-4e4630a3986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.057563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bd051768-a609-4863-854f-4e4630a3986c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:11.059054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bd051768-a609-4863-854f-4e4630a3986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:11.081933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe03387-4802-4fe1-850f-b5ed36bd599e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.138438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.139109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.139388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.139689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.141412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=1b58e128d5794770a80daa121740fb9e) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:11.141412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.142359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54667-241c-45e2-84d4-fabd0095a1c2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.149053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 94/181] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:10 2022] GET /identity/v3/role_assignments?user.id=1b58e128d5794770a80daa121740fb9e&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=6135515bbd37458794241e7a2844577e => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.150686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825985-e997-44e3-8880-fdeacc1eee44 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.151114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825985-e997-44e3-8880-fdeacc1eee44 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.151598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d825985-e997-44e3-8880-fdeacc1eee44 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.153708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 95/182] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:11.159628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d444b-9752-478f-b574-314b7f21d9d8 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.160422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d444b-9752-478f-b574-314b7f21d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.160887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d444b-9752-478f-b574-314b7f21d9d8 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.163300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 96/183] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:11.164929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.165448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.165918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.174802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 88/184] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:11.176490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.176784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.177163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.185501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:11.187004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:11.198033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:11.199109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:11.275905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 89/185] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:11.277509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.282866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 97/186] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:11.309393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.402801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717834a-42bc-4ee5-9ff3-e6b99ce8979e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.450992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.451837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.452124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.452937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.456594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c178d6-18a3-4919-ac80-8b047c15c5c9 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.465595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:11.473428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:11.474830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 90/187] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:11.475823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.493584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.494434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.494910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.495391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.508652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:11.516268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a0fc58a7-5a19-4624-886e-e413d222bdfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:11.517755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 98/188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:11.518826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d00f-3bbc-4e5b-97ee-3118ec5ac10a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.519144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d00f-3bbc-4e5b-97ee-3118ec5ac10a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.519423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3d00f-3bbc-4e5b-97ee-3118ec5ac10a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.521470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 99/189] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:11.522103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d00f-3bbc-4e5b-97ee-3118ec5ac10a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.587885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b51c4-32d2-4b70-973b-d396a4a5401f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.619231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.620051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.620344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.620621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.621659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3d00f-3bbc-4e5b-97ee-3118ec5ac10a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.621770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.623247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9d148-bc4d-4629-b7a2-f1698559b65e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.624878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 91/190] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.626001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.626366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.626649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.644556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:11.645723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:11.655075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.656390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.656674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.656954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.657699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:11.658006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.659385 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.667026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 100/191] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.667846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.708202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 92/192] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:11.709073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.763636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79878c-1789-415e-bd0a-192c10770a93 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.795060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.795740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.796029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.796334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.797071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:11.797378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.798750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.801144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c64b5c-025f-4a49-8b9f-a39a78955873 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.806654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 101/193] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.808352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.833770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.834438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.834723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.835003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.835742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.837198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.901544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4a82-c303-447b-9108-7d39f79c179c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:11.931963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:11.932853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:11.933135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:11.933425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] PATH_INFO: `/v3/users/03429857f64e49c28071727abbef4e08` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:11.934576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] RBAC: Authorizing `identity:get_user(user_id=03429857f64e49c28071727abbef4e08)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:11.936068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:11.938170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 102/194] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/users/03429857f64e49c28071727abbef4e08 => generated 289 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:11.939009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 93/195] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:11 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:11.939114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:11.939951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.042846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305859d3-5ec5-4d63-bf2a-0166cf4ec781 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.065817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be9044-3ef5-47a9-8e98-e65d8d9b5c0e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.077941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.078910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.079204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.079502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.092019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:12.100505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.101159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:12.101385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.101663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.101933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.102639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 103/196] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:12.103314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.123818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.125825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.130720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 94/197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:11 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:12.130720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.219767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde571-d732-49b6-9663-c3b4138bd1a6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.245164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845dd0-ee99-4c3e-ae1d-046bbe693894 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.265434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.266407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.266707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.267000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.286699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.287229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.287441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.287735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.288481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:12.288785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.290194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.300964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 95/198] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:12.302643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.350800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.353381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.408496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2733df9-6284-4dee-b8fb-f6b094666421 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.454013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.454795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.455144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.455503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.469700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 104/199] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:12.470885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.536685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.538984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.581691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150f5dd-8960-4570-8c74-66569f4f3541 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.614767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.615865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.616287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.616697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.618192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.619811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.621550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 105/200] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:12.626767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.659944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 96/201] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:12.661008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.723639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ecdf-f203-47f4-a9ee-3d9f0f8a66a9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.757262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.757609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e8661-4469-42b0-bb47-b77652abf95c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.758353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.758802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.759258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.760707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.762408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.764336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 106/202] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:12.765349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.792386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.793026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.793467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.793883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.862022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.863846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.866706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0422bd-dcbe-4c17-8f81-1ba51dc918fe None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:12.901405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:12.902664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:12.903755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:12.904241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:12.906255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:12.907964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:12.909852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 107/203] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:12.910890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:12.967816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 97/204] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:12.969612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:13.022000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e52ba4-2f73-402c-a844-b63e96b55908 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:13.056514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:13.057411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:13.057871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:13.058317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:13.059325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36, user.id=03429857f64e49c28071727abbef4e08) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:13.059890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:13.061550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:13.067344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e026d-f4c8-4c13-8617-ad4b8b938bc7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:13.067561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 108/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/role_assignments?user.id=03429857f64e49c28071727abbef4e08&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:13.068504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:13.104591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:13.105639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:13.106123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:13.106611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:13.107751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=bdbb4edca6a64822bcd9cf3dfd2d30da) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:13.108300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:13.110052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:13.116787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 98/206] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:12 2022] GET /identity/v3/role_assignments?user.id=bdbb4edca6a64822bcd9cf3dfd2d30da&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:13.181365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f034-44c8-45d5-835f-08550b03cdb7 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:13.222354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:13.223267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:13.223623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:13.223949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:13.225453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:13.227006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0a8c1-5625-4da0-a2b2-26ffcbe5cc80 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:13.229140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 109/207] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:13 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:13.235220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:13.356308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf795-ba61-40c5-8144-64df8b71ce80 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:13.393434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:13.394100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:13.394428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:13.394717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:13.395581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=bdbb4edca6a64822bcd9cf3dfd2d30da) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:13.395896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:13.397374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0e1d-4351-4508-95c3-aae181116d82 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:13.403271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 99/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:13 2022] GET /identity/v3/role_assignments?user.id=bdbb4edca6a64822bcd9cf3dfd2d30da&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=6135515bbd37458794241e7a2844577e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:14.415014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc961-1eb3-48b8-ba88-f8abf6eb9965 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.416089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc961-1eb3-48b8-ba88-f8abf6eb9965 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.416642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc961-1eb3-48b8-ba88-f8abf6eb9965 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.418675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 110/209] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:14.424487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19814-8856-4c1a-a422-754a18b159eb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.425296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19814-8856-4c1a-a422-754a18b159eb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.425771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19814-8856-4c1a-a422-754a18b159eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.444078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9da19814-8856-4c1a-a422-754a18b159eb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:14.445581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9da19814-8856-4c1a-a422-754a18b159eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:14.519753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:14.538009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc961-1eb3-48b8-ba88-f8abf6eb9965 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:14.575393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f38b-dbd5-4d43-8452-b7aab267964b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.575756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f38b-dbd5-4d43-8452-b7aab267964b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.575986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282f38b-dbd5-4d43-8452-b7aab267964b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.577945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 101/211] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:14.583926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.584384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.584810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.605604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:14.607509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:14.647820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc961-1eb3-48b8-ba88-f8abf6eb9965 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:14.688523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:14.689206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 102/212] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:14.689597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.689924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.690240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.704602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:14.711597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:14.713122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 111/213] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:14.718072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:14.720551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:14.815685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14ff2f-8f1c-4a68-8c6e-7cd709d43bfb None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:14.827601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74b7d-b7c6-40f8-92cd-dee474f8d1aa None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:14.851296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:14.852551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.853021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.853470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.854857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:14.856558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:14.859295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 103/214] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:14.865341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:14.868448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:14.869358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:14.869689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:14.870008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:14.871808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:14.872166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:14.873630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:14.888395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 112/215] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:14.889750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:14.999357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434e163-cf02-4263-a21c-cbc58fcbd18b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.006528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c53f-29fc-42c6-baae-c8d4911d3d10 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.041224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.041513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.042286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.042628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.042758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.043133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.043292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.043727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] PATH_INFO: `/v3/users/0b6be763f10d42d8bad79e288696a315` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.044152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:15.045711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:15.058137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6be763f10d42d8bad79e288696a315)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:15.060246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:15.062189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 113/216] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:14 2022] GET /identity/v3/users/0b6be763f10d42d8bad79e288696a315 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:15.067794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:15.143648 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 104/217] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:14 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:15.174728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33b9b-8a95-47eb-b5bd-3c74d2100333 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.215022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.216153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.216639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.217347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.289752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:15.291750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2dd11-d8f8-4ab7-bfe2-d93d2c7ecf7f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:15.403620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 114/218] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:44:15.409596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:15.516536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27c9c-8576-4c36-b241-7de6f35e0eb0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.548630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18890-57e6-4966-933b-535ec56bb609 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.549133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18890-57e6-4966-933b-535ec56bb609 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.549214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18890-57e6-4966-933b-535ec56bb609 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.550962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 115/219] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:15.558588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.558891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.559179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.559410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.560305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.560593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.560868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.563044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:15.564592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:15.566620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 105/220] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:15 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:15.575581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:15.585624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:15.587140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:15.665836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 116/221] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:15.690554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:15.695248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd179f22-5a2f-4577-8812-1a48b9389e1a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.763463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.764497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.765019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.765495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.766623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=0b6be763f10d42d8bad79e288696a315) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:15.767158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:15.769530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc608a4-44ac-44dc-b3db-682fdc163a01 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:15.784036 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 106/222] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:15 2022] GET /identity/v3/role_assignments?user.id=0b6be763f10d42d8bad79e288696a315&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:15.832949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b981f-c320-45c6-89c8-bcf14d2d37b6 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.833622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b981f-c320-45c6-89c8-bcf14d2d37b6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.834107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b981f-c320-45c6-89c8-bcf14d2d37b6 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.836221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 107/223] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:15.842534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.843679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.844168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.844294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086b825-20f8-4b0e-9fa3-d4cdeb209736 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:15.882099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:15.882921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:15.883208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:15.883598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:15.885953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:15.887418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:15.903583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:15.913582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:15.919902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 117/224] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:15.925868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.029690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 108/225] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:16.039186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c16b3-64e2-47aa-b0f3-97478bd34fd5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.059937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.081630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.082301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.082590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.082872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.083651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:16.083965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.085371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.104475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 118/226] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:16.110249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.193449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e34c4-9674-4bdb-9f71-25d296180ef1 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.232127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.232949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.233235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.233549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.245124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:16.253402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:16.254643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 109/227] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:16.260390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.345412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3bea-1677-412d-a294-5b2aa33e8db0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.362513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff937ef-c541-43bb-8677-2c6c4bf13dec None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.396704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.397376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.397664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.397945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.398698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:16.399014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.403493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.408602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 110/228] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:16.414243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.415716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.416855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.417619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.418318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.420182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.427491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.429724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 119/229] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:16.435116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.514703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586ce9f-73df-4bc9-95c6-d8576dbc4759 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.550153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.551030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.551319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.551635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.552857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.554328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.556287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 111/230] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:16.561474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.640337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6968b-ac9f-4a71-a63a-0f0e29753513 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.664963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbeb64-fa6d-45cd-8a8e-5819272ff365 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.681041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.682348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.682639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.682920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.684144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.686347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.689152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 120/231] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:16.694990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.720323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.721250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.721540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.721822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.728226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.729784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.731765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 112/232] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:16 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:16.738101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:16.803104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1abb-033b-43da-812d-ddf5ec69e754 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.841877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.842769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.843093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.843374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/bdbb4edca6a64822bcd9cf3dfd2d30da/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.845398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, user_id=bdbb4edca6a64822bcd9cf3dfd2d30da, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.847419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b9e25-6a62-42ab-bdae-ec810c7da110 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:16.902431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e018d-974f-4599-9d96-b38955d5555d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:16.933425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 121/233] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:16 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/bdbb4edca6a64822bcd9cf3dfd2d30da/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:16.959382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:16.960380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:16.960671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:16.960953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/bdbb4edca6a64822bcd9cf3dfd2d30da/roles/6135515bbd37458794241e7a2844577e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:16.963242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, user_id=bdbb4edca6a64822bcd9cf3dfd2d30da, role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:16.964891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725df72-d97a-4530-90c8-51ee332485fd None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:17.042546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 113/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:16 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/bdbb4edca6a64822bcd9cf3dfd2d30da/roles/6135515bbd37458794241e7a2844577e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:17.919188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6120-e92a-4f94-a9ea-936842f294d8 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:17.919853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6120-e92a-4f94-a9ea-936842f294d8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:17.919853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc6120-e92a-4f94-a9ea-936842f294d8 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:17.921820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 122/235] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:17.927075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e258-8543-4620-9e2b-46c199e36731 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:17.927457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e258-8543-4620-9e2b-46c199e36731 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:17.927671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e258-8543-4620-9e2b-46c199e36731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:17.951297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8803e258-8543-4620-9e2b-46c199e36731 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:17.953110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8803e258-8543-4620-9e2b-46c199e36731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:18.031549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 114/236] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:18.052886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc6120-e92a-4f94-a9ea-936842f294d8 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.181250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc6120-e92a-4f94-a9ea-936842f294d8 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.207339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8f77-0862-431a-b608-5596a4c6d910 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.207658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8f77-0862-431a-b608-5596a4c6d910 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.207938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8f77-0862-431a-b608-5596a4c6d910 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.209986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 115/237] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:18.214915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.215231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.215516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.227150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:18.227985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.228614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.228897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.230249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:18.231748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:18.232175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:18.233361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 123/238] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:18.234251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:18.240492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.342231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2288-4c83-4749-a04d-cd544a5d99d5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.377837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:18.378866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.379352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.379857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.380773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:18.382446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb496f-3661-482b-be36-a67446343c01 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:18.389836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 116/239] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:18.413400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.459640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 124/240] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:18 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:44:18.542906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64587558-b37f-4c25-880a-14a553ae6c0f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.590101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:18.590927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.591217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.591524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.603338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:18.605267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab118-599a-4da7-aa31-6f4bbd79c38b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.605796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab118-599a-4da7-aa31-6f4bbd79c38b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.606285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facab118-599a-4da7-aa31-6f4bbd79c38b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.609071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 125/241] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:18.615733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:18.615733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 117/242] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:18.622455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.630272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.630633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.630924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.657449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:18.658684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:18.758596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 126/243] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:18.776793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47de16-23cd-47bf-97c1-882b186b5e96 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.783567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.822479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:18.823163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.823452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.823761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.824540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:18.824853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:18.826274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:18.837584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 118/244] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:18.844226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:18.900991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebcd27-d5ea-48f6-a7e6-ccaef5694e97 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.938137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:18.938934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:18.939222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:18.939551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:18.955812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:18.962781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:18.964686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6774de8-3e3a-4959-8e87-a16da8ec8b43 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:18.969450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 127/245] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:18.970630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.002187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.003115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.003404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.003726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] PATH_INFO: `/v3/users/cdda818de4e1471f8af7aad9abbce544` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.019075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] RBAC: Authorizing `identity:get_user(user_id=cdda818de4e1471f8af7aad9abbce544)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.021621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.023701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 119/246] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/users/cdda818de4e1471f8af7aad9abbce544 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:19.029833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.075404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478bebd-4198-4e12-afcd-2578e4391824 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.109837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.110505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.110789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.111065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.111843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:19.112150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.113556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.121873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 128/247] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:19.127588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.132972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9359e0f-e38e-49c4-a379-c843cd57fc52 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.170367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.171065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.171356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.171667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.230318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d91e-65ce-428b-9b74-920190e4ff73 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.242550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.244110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.263665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.264538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.265369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.265647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] PATH_INFO: `/v3/users/0b6be763f10d42d8bad79e288696a315` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.266852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6be763f10d42d8bad79e288696a315)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.268357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.274523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 129/248] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:19 2022] GET /identity/v3/users/0b6be763f10d42d8bad79e288696a315 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:19.275741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.345552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 120/249] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:44:19.351058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.376801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e41d9-1549-4cc8-acc1-014c68fae175 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.410757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.411648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.411934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.412213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.413421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.414881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.421372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 130/250] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:19 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:19.422648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.455829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4699a-34d6-46f1-becd-9cba2d9dc9f5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.490867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63119188-9221-4800-a419-370889af0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.491861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119188-9221-4800-a419-370889af0839 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.492157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119188-9221-4800-a419-370889af0839 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.492439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63119188-9221-4800-a419-370889af0839 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.493748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63119188-9221-4800-a419-370889af0839 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.495235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63119188-9221-4800-a419-370889af0839 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.496985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 121/251] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:19 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:19.503316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63119188-9221-4800-a419-370889af0839 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:19.527363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa267e-726a-4a20-9566-ea7b2d254b81 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.560519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.561417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.562235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.562512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/0b6be763f10d42d8bad79e288696a315/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.564673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, user_id=0b6be763f10d42d8bad79e288696a315, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.566138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9e284-4309-41a7-90e6-f533e9568a28 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.610400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63119188-9221-4800-a419-370889af0839 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:19.645620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:19.646576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:19.646965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:19.647361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:19.648285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=cdda818de4e1471f8af7aad9abbce544) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:19.648652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:19.650452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263bfa-0d94-43c3-b766-d137222f54b3 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:19.657343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 122/252] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:19 2022] GET /identity/v3/role_assignments?user.id=cdda818de4e1471f8af7aad9abbce544&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:19.667109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:19 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/0b6be763f10d42d8bad79e288696a315/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:20.189364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dcd8-1b42-4831-9fde-db9ee1c1ddd8 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.189879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dcd8-1b42-4831-9fde-db9ee1c1ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.189956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dcd8-1b42-4831-9fde-db9ee1c1ddd8 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.191961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 123/254] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:20.203188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.204062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.204559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.227731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:20.229214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:20.309775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 132/255] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:20.344014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7dcd8-1b42-4831-9fde-db9ee1c1ddd8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:20.456334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7dcd8-1b42-4831-9fde-db9ee1c1ddd8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:20.490676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:20.491516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.491812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.492091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.502529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:20.509692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-73ac3e2a-c4cf-4436-bae9-5e0926ca4f56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:20.511199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 124/256] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:20.517472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:20.641512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892738eb-0f1a-447f-b006-425f664cd7fe None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.642085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892738eb-0f1a-447f-b006-425f664cd7fe None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.642548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892738eb-0f1a-447f-b006-425f664cd7fe None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.644949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 125/257] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:20.649628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.650437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.650924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.684090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcbafc-396b-4de4-a2a6-bf0eaf98c478 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:20.686654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:20.693559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:20.761438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:20.762029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:20.762320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:20.762598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:20.763353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:20.763687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:20.765628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:20.786664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 133/258] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:20.792513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:20.852925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 126/259] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:20.889409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:20.979618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b008-ff92-4e6f-b92d-f72cc6fc8a8e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.052854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.053652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.054102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.054521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.057985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.059636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:21.060092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00677c-8d0a-4ed9-b83e-d91bb85a8f6f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.062040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 134/260] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:20 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:21.072253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.102041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.103195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.103724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.104202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.114951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:21.122831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:21.125166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 127/261] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:21.132803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.192514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603595a-94c7-4f29-b0ae-ab0b13291851 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.226557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.227954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.228385 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.228805 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.242614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ec5c-52fb-4c05-8397-5e4fa585dc8e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.277171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.277992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.278414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.278786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.279805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:21.280421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.282056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:21.291032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:21.297049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.298267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.299945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:21.416855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb879c5-a6ee-4619-b2e1-0bb2812878b5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.430347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 135/263] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:21.453990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.482715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.485743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.486311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.486969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] PATH_INFO: `/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.489642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] RBAC: Authorizing `identity:get_user(user_id=bdbb4edca6a64822bcd9cf3dfd2d30da)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.491605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:21.495436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 129/264] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/users/bdbb4edca6a64822bcd9cf3dfd2d30da => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:21.505581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.658217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09227bf3-979c-4338-9c80-6bcd7df09153 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.711346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89fd5-a69e-4d92-80e4-9ee043b25528 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:21.722861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.724150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.724644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.725217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.730325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.732698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:21.735553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 136/265] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:21.742611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:21.772316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:21.772999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:21.773289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:21.773574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:21.919269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:21.920904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.031899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d247bf-3371-4cb7-82d6-719a753f3722 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.092188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.094579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.094579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.094579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.095194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=bdbb4edca6a64822bcd9cf3dfd2d30da) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:22.095708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:22.097295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.108045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 137/266] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/role_assignments?user.id=bdbb4edca6a64822bcd9cf3dfd2d30da&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:22.108999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 130/267] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:22.114135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:22.256964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16568dd-0d23-4540-8ffe-213e22c34028 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.302712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.303526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.303817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.304093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.305381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:22.306873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533d7ae-fd97-44d8-9569-cd015443458f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.308626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 138/268] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:22 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:22.315536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:22.319498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488293-5c62-4ec9-8326-62e0af319857 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.319498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488293-5c62-4ec9-8326-62e0af319857 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.319498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488293-5c62-4ec9-8326-62e0af319857 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.319958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 139/269] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:22.337428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c9fe-6285-40b2-a552-a6e083b66e17 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.337732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c9fe-6285-40b2-a552-a6e083b66e17 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.338001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c9fe-6285-40b2-a552-a6e083b66e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.369504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f247c9fe-6285-40b2-a552-a6e083b66e17 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:22.370754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f247c9fe-6285-40b2-a552-a6e083b66e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:22.464350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836c8d-772a-4de1-828b-0bcce7d32471 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.505829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 140/270] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:22.507591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaa6e-e356-47fd-a592-3bd32f01c1bd None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.508084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaa6e-e356-47fd-a592-3bd32f01c1bd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.508559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaa6e-e356-47fd-a592-3bd32f01c1bd None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.510484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 141/271] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:22.518966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.519575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.520061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.538274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:22.540030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:22.542285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.542958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.543247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.543612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.545003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=bdbb4edca6a64822bcd9cf3dfd2d30da) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:22.545003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:22.546267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.557952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 131/272] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:22 2022] GET /identity/v3/role_assignments?user.id=bdbb4edca6a64822bcd9cf3dfd2d30da&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=6135515bbd37458794241e7a2844577e => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:22.558610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:22.631424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 142/273] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:22.668101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:22.694889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35212cc-e54c-4106-934a-8e03d2699ad3 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.739150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.740258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.740714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.741137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.742532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:22.744535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.746611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 132/274] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:22.752806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:22.868372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552594d-03cf-4368-9c82-68cd5325bfb6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.887606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce889-2bc4-47f4-b6b8-d4b085886b84 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:22.905774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.906609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.910271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.910658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.923142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:22.928675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:22.929552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:22.929983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:22.930413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:22.931283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:22.931515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:22.932904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 143/275] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:22.933348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f2496-e3be-4241-8f12-82925dc28fac None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:22.939609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.043253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 133/276] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:22 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:44:23.047503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1389ba-2889-4bea-885a-aa92bfc47d13 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.048571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1389ba-2889-4bea-885a-aa92bfc47d13 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.049229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1389ba-2889-4bea-885a-aa92bfc47d13 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.052433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 134/277] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:23.062554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.063189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.064016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.068299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf441e-49ca-41a7-b287-13414d7e0519 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.086657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:23.088297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:23.107571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.108315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.109116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.109391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.110156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:23.110461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.111939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.121320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 144/278] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:23.127004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.181919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 135/279] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:23.204909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.250176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8701-038c-4f47-88ee-76bf3847a917 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.289934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.290811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.291096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.291371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] PATH_INFO: `/v3/users/1612e953a2b74b159f1b7a5ab68d11ff` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.305366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] RBAC: Authorizing `identity:get_user(user_id=1612e953a2b74b159f1b7a5ab68d11ff)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.306849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.309471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 145/280] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/users/1612e953a2b74b159f1b7a5ab68d11ff => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:23.315100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.328645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf1f2-a554-457b-8f60-6b9b1bf00409 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.368064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.368872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.369160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.369478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.386078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:23.393170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2735dfa9-2f43-4c09-889a-b36e7940bc1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:23.394571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 136/281] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:23.396226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e4d4-7b5a-4a63-8791-d19d95945bc4 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.396524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e4d4-7b5a-4a63-8791-d19d95945bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.396807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e4d4-7b5a-4a63-8791-d19d95945bc4 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.398777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 137/282] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:23.400663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e4d4-7b5a-4a63-8791-d19d95945bc4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.428030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ffbad-99ca-4855-bdb9-ea42316c337e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.466406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.467068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.467403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.468663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.469561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, user.id=1612e953a2b74b159f1b7a5ab68d11ff, scope.system=all) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:23.469879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.471403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458bb44-009f-47de-a1a8-38f37505b772 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.477175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 146/283] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/role_assignments?user.id=1612e953a2b74b159f1b7a5ab68d11ff&scope.system=all&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:23.478466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.478762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.479046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.496661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:23.497901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:23.536242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e4d4-7b5a-4a63-8791-d19d95945bc4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.571836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 147/284] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:23.597569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.614251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.615330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.615846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.616325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.617480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:23.618026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.619749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.646309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 138/285] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:23.651458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.708288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff9e2e-1051-472f-b862-d5d97aa5d1b3 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.743494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.745256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.745256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.745256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.756255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:23.763673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:23.765261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 148/286] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:23.775518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.851348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee0a-7a81-4932-94e7-029297033c03 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.872341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c013ad-916f-4c14-a00d-9d2944172509 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:23.906178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.906760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.907162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.907438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.908500 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:23.908812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.910387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.912736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:23.913626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:23.913917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:23.914199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] PATH_INFO: `/v3/users/cdda818de4e1471f8af7aad9abbce544` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:23.915480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] RBAC: Authorizing `identity:get_user(user_id=cdda818de4e1471f8af7aad9abbce544)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:23.916974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:23.918932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 139/287] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/users/cdda818de4e1471f8af7aad9abbce544 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:23.919042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 149/288] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:23.924708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:23.925104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:24.029939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bc590-b754-41f5-8270-9c8610c186ba None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.064407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.065278 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.065569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.065864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.067059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.068592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.070582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 140/289] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:24.080591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014491e-bb10-4ca4-af28-f90b45a4a12a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.090482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:24.128141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.129007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.129290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.129564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] PATH_INFO: `/v3/users/0b6be763f10d42d8bad79e288696a315` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.130778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6be763f10d42d8bad79e288696a315)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.132240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.134157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 150/290] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:23 2022] GET /identity/v3/users/0b6be763f10d42d8bad79e288696a315 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:24.139013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:24.194777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd7d3-0eb5-4bd7-b240-a2259e5257bb None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.230462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.231352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.231681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.231964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/cdda818de4e1471f8af7aad9abbce544/roles/2ce0d9c04e294781826bcd37c7b3df4d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.236263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, user_id=cdda818de4e1471f8af7aad9abbce544, role_id=2ce0d9c04e294781826bcd37c7b3df4d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.238540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.295737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165cf3-35ca-45d4-a730-b6021137b990 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.316791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:44:24 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/users/cdda818de4e1471f8af7aad9abbce544/roles/2ce0d9c04e294781826bcd37c7b3df4d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:24.344044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.344712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.345051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.345332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.432483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.434040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.559839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 151/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:24.565304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:24.685781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd0c67-8282-4468-87dd-4d4d2a12518f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.720562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.721472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.721762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.722042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.723234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.724777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ec54c-17c1-464f-8768-7060f8276b98 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.726760 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 142/293] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:24 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:24.732236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:24.845622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717767-db7c-47ed-b9c0-c9e5468f6ec5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:24.885873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:24.886531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:24.886869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:24.887151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:24.888006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=0b6be763f10d42d8bad79e288696a315) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:24.888319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:24.890316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e31fb-2185-4802-be0c-5fa164934580 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:24.900174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 152/294] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:24 2022] GET /identity/v3/role_assignments?user.id=0b6be763f10d42d8bad79e288696a315&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:25.712727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882a60-f092-4d55-9e14-c453fe243a39 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:25.713241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882a60-f092-4d55-9e14-c453fe243a39 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:25.713316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882a60-f092-4d55-9e14-c453fe243a39 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:25.715055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 143/295] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:25.720438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3efcbb-6651-4c65-8dc6-dd81ad5e36f0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:25.720854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3efcbb-6651-4c65-8dc6-dd81ad5e36f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:25.721022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3efcbb-6651-4c65-8dc6-dd81ad5e36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:25.739011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-aa3efcbb-6651-4c65-8dc6-dd81ad5e36f0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:25.740226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa3efcbb-6651-4c65-8dc6-dd81ad5e36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:25.807958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:25.831760 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9882a60-f092-4d55-9e14-c453fe243a39 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:25.933568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9882a60-f092-4d55-9e14-c453fe243a39 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:25.966895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3035e-5506-44b3-88de-d3ff657fcb6e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:25.967180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3035e-5506-44b3-88de-d3ff657fcb6e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:25.967596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3035e-5506-44b3-88de-d3ff657fcb6e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:25.969782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 154/297] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:25.971877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:25.972697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:25.972978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:25.973256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:25.975304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:25.975715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:25.976144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:25.985238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:25.994053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:25.994186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:25.994263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 144/298] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:25.994623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:26.000197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.079966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 155/299] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:26.100805 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.105821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1f4b-ceac-412a-9e8c-28ab81f76090 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.139629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.140396 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.140748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.141093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.141909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:26.142285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.143776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.152537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 145/300] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:26.158453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.218880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92784bed-14e6-4dff-a7b2-d0577e2d18b4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.260817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.261865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.262151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.262430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.263496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5e544-546a-4e73-8a4e-1a6b7a8c426a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.263700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.265274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.271561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 156/301] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:26.273026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.300817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.301685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.301972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.302246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] PATH_INFO: `/v3/users/413ea71d72904420b84d5a148be975ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.315851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] RBAC: Authorizing `identity:get_user(user_id=413ea71d72904420b84d5a148be975ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.317742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.324707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 146/302] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/users/413ea71d72904420b84d5a148be975ab => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:26.325615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.381316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97cf1c-afc9-4878-9845-e845bcbee674 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.419881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.420543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.421386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.421486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97a47-b6a0-4f82-84d8-d56d0a17da79 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.421667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] PATH_INFO: `/v3/groups` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.422354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.424150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.454313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.454970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.455254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.455616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.456432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, user.id=413ea71d72904420b84d5a148be975ab, scope.system=all) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:26.456777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.458219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a06ac-d71b-4e5d-89b3-c45a500a7d39 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.462985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 147/303] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/role_assignments?user.id=413ea71d72904420b84d5a148be975ab&scope.system=all&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:26.464262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bff82-58a4-4644-b269-2349434d357b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.464545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bff82-58a4-4644-b269-2349434d357b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.464819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bff82-58a4-4644-b269-2349434d357b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.466749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 148/304] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:26.474242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.474242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.474242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.491464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:26.492731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:26.504729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 157/305] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Feb 28 12:44:26 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:44:26.585387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 149/306] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:26.609168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.721656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f56805-9cdd-409b-9db3-6727eca57eec None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.754350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.755073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.755359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.755666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.766824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:26.773826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ceadf86a-7b71-49c5-80ac-c99bda914695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:26.775031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 158/307] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:26.781278 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:26.931445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde6f1-3cd0-4694-977b-3f50a716f647 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:26.972412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:26.973494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.973979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.974454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.974942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770369b-d96c-4a98-aa41-1a460afbdbd5 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.975235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770369b-d96c-4a98-aa41-1a460afbdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.975547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770369b-d96c-4a98-aa41-1a460afbdbd5 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.976139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:26.976648 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:26.977563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 159/308] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:26.978555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:26.982306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:26.982594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:26.982869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:26.993964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 150/309] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:27.000225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:27.000429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.001397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:27.070739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 160/310] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:27.094923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.100171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a6b44-face-4491-87aa-7f6fbce08667 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.134139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.135005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.135290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.135598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] PATH_INFO: `/v3/users/1612e953a2b74b159f1b7a5ab68d11ff` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.136792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] RBAC: Authorizing `identity:get_user(user_id=1612e953a2b74b159f1b7a5ab68d11ff)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:27.138254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:27.145112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 151/311] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:26 2022] GET /identity/v3/users/1612e953a2b74b159f1b7a5ab68d11ff => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:27.145893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.192558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ea4ed-2029-4d88-98fa-871eb1ab7ab5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.226470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.227571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.228026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.228473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.239316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:27.245644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8afa-eb64-475b-a6bc-cbe788f4d949 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.246717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:27.248441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 161/312] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:27.256868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.282029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.283172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.283452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.283754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] PATH_INFO: `/v3/system/users/1612e953a2b74b159f1b7a5ab68d11ff/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.285240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1612e953a2b74b159f1b7a5ab68d11ff, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:27.286652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:27.366512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a340-7a29-4307-baf1-8cea5264fe23 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.385134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 152/313] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Feb 28 12:44:27 2022] PUT /identity/v3/system/users/1612e953a2b74b159f1b7a5ab68d11ff/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:27.411969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.413135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.413642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.414178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.415188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] RBAC: Adding query filter params (name=reader) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:27.415732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:27.417683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:27.428584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 162/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:27.437601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.544858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8de-f07c-4ff5-9c49-8b8fc227f34b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.580560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.581671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.582118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.582531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] PATH_INFO: `/v3/users/cdda818de4e1471f8af7aad9abbce544` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.583946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] RBAC: Authorizing `identity:get_user(user_id=cdda818de4e1471f8af7aad9abbce544)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:27.585546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:27.587660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 153/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:27 2022] GET /identity/v3/users/cdda818de4e1471f8af7aad9abbce544 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:27.593422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:27.698614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cba36c-f1ab-4129-9aba-e1b2599bbbab None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:27.732654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:27.734545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:27.734993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:27.735407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:27.804639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:27.806387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:27.956076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 163/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:27.961330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:28.065296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677f499-760d-45d5-b8d7-0a939b3f5dff None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:28.098949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:28.100177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.100666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.101163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:28.102544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:28.104233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ad5a8-10cf-484e-80cd-35dafede9ed8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:28.106464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 154/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:27 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:28.112539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:28.210881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862025-3fa0-4884-9044-18dec643bb22 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:28.244738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9948974-82a5-4708-a56b-629110478316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:28.245388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948974-82a5-4708-a56b-629110478316 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.245672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948974-82a5-4708-a56b-629110478316 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.245945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9948974-82a5-4708-a56b-629110478316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:28.246762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9948974-82a5-4708-a56b-629110478316 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700, user.id=cdda818de4e1471f8af7aad9abbce544) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:28.247072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9948974-82a5-4708-a56b-629110478316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:28.248530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9948974-82a5-4708-a56b-629110478316 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:28.254672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 164/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:28 2022] GET /identity/v3/role_assignments?user.id=cdda818de4e1471f8af7aad9abbce544&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:28.861218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481beb2d-14c8-497d-95d6-fc307a8e0435 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.861502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481beb2d-14c8-497d-95d6-fc307a8e0435 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.861958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481beb2d-14c8-497d-95d6-fc307a8e0435 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:28.863990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 155/319] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:28.869020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0022-f876-44a2-8d5f-8ebb0f571391 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.869460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0022-f876-44a2-8d5f-8ebb0f571391 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.869638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0022-f876-44a2-8d5f-8ebb0f571391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:28.886857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-26eb0022-f876-44a2-8d5f-8ebb0f571391 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:28.888047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-26eb0022-f876-44a2-8d5f-8ebb0f571391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:28.956081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 165/320] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:28.978245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481beb2d-14c8-497d-95d6-fc307a8e0435 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:28.986510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acac30-cf3a-4ba4-8605-975cfc81ed7a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.986801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acac30-cf3a-4ba4-8605-975cfc81ed7a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.989284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acac30-cf3a-4ba4-8605-975cfc81ed7a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:28.989284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 166/321] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:28.993908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:28.994196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:28.994473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.011047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:29.012404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:29.079220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 167/322] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:29.088895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481beb2d-14c8-497d-95d6-fc307a8e0435 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.102323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.123109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.124382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.124670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.124946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.135448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:29.143011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:29.144425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 156/323] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:29.149969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.196450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae50dd-a99a-449e-8181-b0c055e4b597 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.229927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.231082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.231621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.231965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.233139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:29.234627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:29.240489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 168/324] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:29.241550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.245693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2a98-e567-423c-851d-52884da85ad5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.279987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.280932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.281394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.281844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.282784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:29.283268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:29.284860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:29.293012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 157/325] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:29.298388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.338460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a76743-7e5d-4de9-8e4c-56af2eb66798 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.373001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.374258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.374487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.374763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] PATH_INFO: `/v3/groups` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.375450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:29.376912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f25cd-b757-4806-b98c-30b39d4e507b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:29.398385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cdfa5-fbad-4d90-a89f-01f5e1ea3ab1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.429890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.430751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.431035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.431310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] PATH_INFO: `/v3/users/413ea71d72904420b84d5a148be975ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.432497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] RBAC: Authorizing `identity:get_user(user_id=413ea71d72904420b84d5a148be975ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:29.433934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:29.437979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 158/326] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:29 2022] GET /identity/v3/users/413ea71d72904420b84d5a148be975ab => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:29.441390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.476830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 169/327] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Feb 28 12:44:29 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:29.544056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2156a8a-7b68-4a1a-a4cb-b73d2c1f13bc None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.579514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.580387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.580668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.580944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] PATH_INFO: `/v3/system/users/413ea71d72904420b84d5a148be975ab/roles/2ce0d9c04e294781826bcd37c7b3df4d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.582471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=413ea71d72904420b84d5a148be975ab, role_id=2ce0d9c04e294781826bcd37c7b3df4d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:29.583920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8f1e7-c58c-4efb-a9d7-ea62aa9d861e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:29.653666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 159/328] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Feb 28 12:44:29 2022] PUT /identity/v3/system/users/413ea71d72904420b84d5a148be975ab/roles/2ce0d9c04e294781826bcd37c7b3df4d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:29.718084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab09e8-bda5-4f0d-839d-e26acf5b8964 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.718350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab09e8-bda5-4f0d-839d-e26acf5b8964 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.718629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab09e8-bda5-4f0d-839d-e26acf5b8964 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.720695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 170/329] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:29.726668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.726996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.727245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.747790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:29.749934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:29.824104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 160/330] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:29.848810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab09e8-bda5-4f0d-839d-e26acf5b8964 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:29.951312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab09e8-bda5-4f0d-839d-e26acf5b8964 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:29.986313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:29.987119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:29.987405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:29.987708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:29.999186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:30.006356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:30.007890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 171/331] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:30.013611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:30.114178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175b60c-d758-41b1-8a5b-0e02b14a8fd4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:30.147179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:30.147886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:30.148169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:30.148446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:30.149200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:30.149505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:30.150954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:30.160118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 161/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:30.165660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:30.268898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369541-464b-4ead-bc8a-58dba2b16176 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:30.305879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:30.306814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:30.307143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:30.307417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] PATH_INFO: `/v3/users/1612e953a2b74b159f1b7a5ab68d11ff` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:30.308628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] RBAC: Authorizing `identity:get_user(user_id=1612e953a2b74b159f1b7a5ab68d11ff)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:30.310068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a31712-3751-4a8a-9257-39617bbd4846 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:30.312013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 172/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:30 2022] GET /identity/v3/users/1612e953a2b74b159f1b7a5ab68d11ff => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:30.317728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:30.419783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03448f-d598-41a2-9aba-d859912fe6df None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:30.453410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:30.454061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:30.454342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:30.454619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:30.455443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] RBAC: Adding query filter params (role.id=8f80caecbcc747418e3bf59033daf4ab, user.id=1612e953a2b74b159f1b7a5ab68d11ff, scope.system=all) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:30.455861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:30.457314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b4aa-27bc-4d62-be7a-d0886248c881 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:30.470184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 162/334] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Feb 28 12:44:30 2022] GET /identity/v3/role_assignments?user.id=1612e953a2b74b159f1b7a5ab68d11ff&scope.system=all&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:32.449873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7a5-0617-4641-aa4c-c3bff8bdb259 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.450875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7a5-0617-4641-aa4c-c3bff8bdb259 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.451355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7a5-0617-4641-aa4c-c3bff8bdb259 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.454256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 173/335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:32.459463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.460304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.460735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.484529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:32.485961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:32.574801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 163/336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:32.606488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa7a5-0617-4641-aa4c-c3bff8bdb259 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:32.718699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa7a5-0617-4641-aa4c-c3bff8bdb259 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:32.754153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:32.755189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.755666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.756090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.774294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:32.781442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-975edc35-e656-484a-86cf-04552409dd4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:32.783726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 174/337] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:32.788471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:32.866008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e68e-cb97-4e2c-956b-d7ed34758076 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.866647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e68e-cb97-4e2c-956b-d7ed34758076 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.867132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411e68e-cb97-4e2c-956b-d7ed34758076 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.870168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 175/338] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:32.874218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c1e0-7323-41fc-abff-f55e442e6fd9 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.874692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c1e0-7323-41fc-abff-f55e442e6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.875153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c1e0-7323-41fc-abff-f55e442e6fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.909390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94564678-1a2d-4b37-82af-67e031d1e835 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:32.910554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-fa78c1e0-7323-41fc-abff-f55e442e6fd9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:32.912014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fa78c1e0-7323-41fc-abff-f55e442e6fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:32.953325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:32.954241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.954671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.960513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.960513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:32.960513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:32.960513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c309b0-c885-46ef-9e92-319c227cad1d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:32.966481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 164/339] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:32.968591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560368-a4c3-47fb-82c8-5ff3c9499e06 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:32.969080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560368-a4c3-47fb-82c8-5ff3c9499e06 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:32.969502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560368-a4c3-47fb-82c8-5ff3c9499e06 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:32.971318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 165/340] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:32.973458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99560368-a4c3-47fb-82c8-5ff3c9499e06 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.046950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 176/341] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:33.048510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634619b-72f9-4c12-811c-64e5aec6a61a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.048906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634619b-72f9-4c12-811c-64e5aec6a61a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.049283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634619b-72f9-4c12-811c-64e5aec6a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.066299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b634619b-72f9-4c12-811c-64e5aec6a61a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:33.067853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b634619b-72f9-4c12-811c-64e5aec6a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:33.084944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99560368-a4c3-47fb-82c8-5ff3c9499e06 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.120722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.121609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.122039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.122489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.160935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 177/342] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:33.163246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef6e2-e4aa-4d90-a715-4ecb34cad6b2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.163703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef6e2-e4aa-4d90-a715-4ecb34cad6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.164157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ef6e2-e4aa-4d90-a715-4ecb34cad6b2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.166629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 178/343] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:33.167652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef6e2-e4aa-4d90-a715-4ecb34cad6b2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.203298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:33.205633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b416-8bc2-40ec-b960-4a0c2ea17e3f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:33.293006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ef6e2-e4aa-4d90-a715-4ecb34cad6b2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.313244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 166/344] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:33.315014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.315553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.316008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.334895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.336114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.336410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.336677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.338217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:33.339722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:33.347751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:33.354992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:33.356519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 179/345] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:33.357295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.410678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 167/346] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:33.411978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.463625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29655-1f59-4c3b-bbec-964fd093e2b6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.497299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.498101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.498382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.498686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.508848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:33.516317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 12:44:33.517691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 180/347] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:33.518320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.518754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a9570-8546-483d-8a91-bb51c0766e58 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.555783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.557016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.557509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.558006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.559451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:33.561247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:33.565137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 168/348] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:33.566179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.625128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836b101-64c8-4ed3-b7b4-76ab9c241433 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.658693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.659357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.659679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.659957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.660783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:33.661285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:33.662672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:33.670567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750820ea-6b5e-469a-ac20-397ecc8b14fb None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.672396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 181/349] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:33.673375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.708565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.709798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.710339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.710817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.722054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:33.729634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:33.731368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 169/350] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:33.732479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.778994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f88bb-ad3f-4538-85fe-3f70082a149e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.814818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.815428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.815738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.816018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.816770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:33.817074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:33.818462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:33.827817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 182/351] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:33.828626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.843187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b7a3-f90d-4c3f-9ff5-3bcec6ce6cfe None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.878343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.879614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.880100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.880587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:33.887306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:33.889101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:33.891577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 170/352] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:33.892553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:33.928851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c37f4e-d339-4218-be62-d613c83442f5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:33.962912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:33.963586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:33.963872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:33.964148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.008668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414d3ce-5a6c-44b0-aa99-67aaccf9fbe4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.032790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.034336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.045160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.046776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.047259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.048791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.052740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:34.052740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.052740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.061098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 171/353] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.062874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.135627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 183/354] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:34.136616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.168262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24050a-c741-447a-a731-4108a477f696 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.203732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.204969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.205603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.206111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] PATH_INFO: `/v3/users/413ea71d72904420b84d5a148be975ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.207682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] RBAC: Authorizing `identity:get_user(user_id=413ea71d72904420b84d5a148be975ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.209417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.211652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 172/355] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/users/413ea71d72904420b84d5a148be975ab => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.212654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.235624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610f81d-7691-4895-9fdf-e2905487c8e0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.291893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.291893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.291893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.291893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.292732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:34.293045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.294508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.303975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 184/356] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.304519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.346395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edbf05-6eb2-4746-bb5a-6669760b149b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.387894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.389004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.389513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.390065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.413276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8fe2d-c7cc-44d2-bc26-3da7fed9a8d3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.450300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.451165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.451455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.451815 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.453394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.454872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.457059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 185/357] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.457952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.471365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.473316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c72a7-ea70-45e5-a5d8-9b8569515e10 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.561121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02b6a-4225-4821-8a09-bd508371e056 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.577965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 173/358] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:34.579963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e6d87-f1de-4cb2-b831-f91abc14e6dd None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.580483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e6d87-f1de-4cb2-b831-f91abc14e6dd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.581772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e6d87-f1de-4cb2-b831-f91abc14e6dd None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.584019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 174/359] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:34.584969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e6d87-f1de-4cb2-b831-f91abc14e6dd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.601819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.602485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.602772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.603048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.603922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] RBAC: Adding query filter params (role.id=2ce0d9c04e294781826bcd37c7b3df4d, user.id=413ea71d72904420b84d5a148be975ab, scope.system=all) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:34.604233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.605679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.619859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 186/360] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/role_assignments?user.id=413ea71d72904420b84d5a148be975ab&scope.system=all&role.id=2ce0d9c04e294781826bcd37c7b3df4d => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.620711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.722744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e6d87-f1de-4cb2-b831-f91abc14e6dd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.754670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e540c-e473-4605-ac34-5a91ae2bc140 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.775138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.776526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.777009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.777479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.779008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.781357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1ae1c-9af2-4783-9c0c-85caecbec412 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.783620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 175/361] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.785173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66992-e000-4420-962a-b40e0df93120 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.785683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66992-e000-4420-962a-b40e0df93120 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.786168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66992-e000-4420-962a-b40e0df93120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.804138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.805014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.805299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.805574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.806352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-96e66992-e000-4420-962a-b40e0df93120 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:34.806790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.809778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e378641-355a-450f-93c1-23cf0beaeb15 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:34.810188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 187/362] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:34.811210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-96e66992-e000-4420-962a-b40e0df93120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:34.811409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8044-a5cd-4037-bf63-dbd7031410be None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.812452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8044-a5cd-4037-bf63-dbd7031410be None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.812739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b8044-a5cd-4037-bf63-dbd7031410be None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.818870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 188/363] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:34.818870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8044-a5cd-4037-bf63-dbd7031410be None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.900253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 176/364] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:34.901106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66992-e000-4420-962a-b40e0df93120 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:34.939534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b8044-a5cd-4037-bf63-dbd7031410be None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:34.989670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:34.990254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:34.990544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:34.990823 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:34.991735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=6135515bbd37458794241e7a2844577e, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:34.991999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:34.993450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a911df-4c1d-4f46-bf67-f65639b632cc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.004550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 189/365] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=6135515bbd37458794241e7a2844577e => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:35.006188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.006824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.007841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.027276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66992-e000-4420-962a-b40e0df93120 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.033031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:35.033813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:35.113197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 190/366] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:35.114144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.227045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.227912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.228193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.228468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.229719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:35.231109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.233120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 177/367] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:34 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:35.233889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.263932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fe72-9275-4b15-8b34-be6c3106b595 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.298341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.299167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.299452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.299756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.310283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:35.318279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:35.319547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 191/368] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:35.320548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.343336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134124-8694-453f-bdb8-390377a5b34a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.377376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.378168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.378450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.378722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.389085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:35.396549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:35.398060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 178/369] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:35.398846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.424045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45df89-ae4a-4f7d-af8f-87ea0c42a9e5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.459866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.460566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.460861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.461143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.461975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:35.462288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:35.463758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.469763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 192/370] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:35.470643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.502062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558e338-8bb6-4de4-a9ad-3448ccc1bfbf None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.537326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.537919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.538201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.538479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.539230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:35.539564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:35.540951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.551334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 179/371] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:35.557007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.575637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b2b-b30b-49fa-8fcb-cbdfd3ed3be4 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.613838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.614520 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.614807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.615086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.616607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:35.616910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:35.618318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.627646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 193/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:35.634557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:35.673497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c30f3-d7b5-425b-86d1-521c79b6994e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.716412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.717346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.717681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.717966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.821387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478ed98-6b1d-4d26-9730-119b911273c5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:35.824320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:35.825799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:35.864325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:35.864996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:35.865282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:35.865560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:35.958090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 180/373] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:35.963673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.046926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.048527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.088911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14bdac-ba19-4b7f-8765-bedc7a3fa969 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.129777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.130636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.130918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.131195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.134288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.141693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.143821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 181/374] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:36.148890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.237795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 194/375] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:36.243374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.287187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef96a9-2482-4985-9603-b5055e4e8082 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.345538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724c277-84ed-49fe-9cf7-fc31e8cab1d2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.365584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.366451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.366736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.367011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.372467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.374040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.375846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 182/376] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:36 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:36.382019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.383993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.384870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.385155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.385428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] PATH_INFO: `/v3/projects/a00bab95afbd472db33af396a6aecd67` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.386627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] RBAC: Authorizing `identity:get_project(project_id=a00bab95afbd472db33af396a6aecd67)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.388119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.390525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 195/377] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:36 2022] GET /identity/v3/projects/a00bab95afbd472db33af396a6aecd67 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:36.405477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.547747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a9bdb-f374-4916-99be-47edc2c68db6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.548585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694519df-f79b-4c21-8210-5f46c06211af None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.593312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.593978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.594259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.594532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.595357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=6135515bbd37458794241e7a2844577e, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:36.595745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.597145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.604608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.605462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.605741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.606011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] PATH_INFO: `/v3/groups/6843626cf6264ba2a384593aa20d76e9` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.608633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 183/378] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:36 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=6135515bbd37458794241e7a2844577e => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:36.614412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] RBAC: Authorizing `identity:get_group(group_id=6843626cf6264ba2a384593aa20d76e9)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.615965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43e55-c3bf-477c-8c83-c8f76664a943 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.618020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 196/379] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:36 2022] GET /identity/v3/groups/6843626cf6264ba2a384593aa20d76e9 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:36.624560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:36.747977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f56a0-9e5d-4c6b-9cb5-b895d4e11a59 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:36.803135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:36.803897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:36.804192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:36.804474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:36.805333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] RBAC: Adding query filter params (group.id=6843626cf6264ba2a384593aa20d76e9, role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=a00bab95afbd472db33af396a6aecd67) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:36.805654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:36.807202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9964dc-0367-4ef3-b17b-bb3db2fa2b1c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:36.814319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 184/380] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:36 2022] GET /identity/v3/role_assignments?group.id=6843626cf6264ba2a384593aa20d76e9&scope.project.id=a00bab95afbd472db33af396a6aecd67&role.id=02948fe3aa224688a909554882ca78f6 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:37.215059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb796d9-e0dc-4d5c-aee1-cb08ed184180 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.215396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb796d9-e0dc-4d5c-aee1-cb08ed184180 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.215606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb796d9-e0dc-4d5c-aee1-cb08ed184180 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.217769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 197/381] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:37.222872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.223164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.223441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.243864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:37.245158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:37.319619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 185/382] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:37.351493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb796d9-e0dc-4d5c-aee1-cb08ed184180 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:37.483538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb796d9-e0dc-4d5c-aee1-cb08ed184180 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:37.520576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:37.521369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.521648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.521921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.532999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:37.539994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:37.541535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 198/383] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:37.547882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:37.701370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b513d-8131-44bb-b873-d3dd012228a5 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:37.748091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:37.749248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.749494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.749771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.750550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:37.750997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:37.752466 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4b44-d4a8-42d5-8aae-30f0935442e1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:37.767019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 186/384] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:37.772475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:37.903852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e4cae-969c-4a4f-9f85-94229f16efdf None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:37.905350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130f38-047f-4d50-a683-3a69f3a3b33b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.905639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130f38-047f-4d50-a683-3a69f3a3b33b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.905917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130f38-047f-4d50-a683-3a69f3a3b33b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.911496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 187/385] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:37.913279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.913577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.913859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.952679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:37.953882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:37.969307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:37.970505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:37.970978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:37.971427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:37.973950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:37.975649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:37.978621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 199/386] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:37 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:37.987314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.088608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 188/387] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:38.144913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.158061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0715-621e-4491-bb1c-b1c17c1f0b69 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:38.221093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:38.222021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.222303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.222579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.223800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:38.225237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:38.229831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 200/388] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:37 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:38.237698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.276499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f6ba-39a9-49d9-9819-b3e1d27675c7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:38.343139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:38.346807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.347314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.347801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.372862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:38.380444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:38.382323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 189/389] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:38.389433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.416213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d993fb-c216-4bbf-b9a8-e76e1b16d0a8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:38.481683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:38.482977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.483639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.485232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.491647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, group_id=050ee54bc6e44e2d8ea1d32cf6db1d12, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:38.493434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:38.551429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08802fa-ada2-4f6a-be35-6974d2ad3454 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:38.580696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 201/390] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Feb 28 12:44:38 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:38.621089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:38.622145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.622634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.623113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.624260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:38.624877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:38.626591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:38.637252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 190/391] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:38.643695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.801302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed552-2389-4a97-a194-55c9fa23c497 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:38.850207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:38.851078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.851363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.851672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.856329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:38.857923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda9177-d733-47be-8284-079a54248c97 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:38.860186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 202/392] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:38 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:38.867144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:38.925892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ea3-2ef4-4e21-af6f-3f1ee6b2d7ad None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.926196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ea3-2ef4-4e21-af6f-3f1ee6b2d7ad None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.926475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ea3-2ef4-4e21-af6f-3f1ee6b2d7ad None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.928698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 203/393] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:38.939657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:38.939947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:38.940401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:38.975282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:38.977600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:39.016327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83043d36-4c24-458e-8660-1ddb71674c15 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.080735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:39.081970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.082608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.084309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.086571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:39.089618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:39.090091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 204/394] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:39.092368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 191/395] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:38 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:39.097768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.114904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.228017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5687fd4-4ddd-4043-82f0-2e0a6d43b7e0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.267712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:39.268944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.269421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.270057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/6135515bbd37458794241e7a2844577e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.275333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7fff96d7f7d4a84b0510d204e7a1e36, group_id=050ee54bc6e44e2d8ea1d32cf6db1d12, role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:39.277075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:39.300837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafd66d-844b-4a08-b8f3-67ee8bc3aeb2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.346155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:39.347399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.347930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.348400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.361824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:39.369375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:39.371242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 192/396] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:39.378917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 205/397] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Feb 28 12:44:39 2022] PUT /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/6135515bbd37458794241e7a2844577e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:39.379043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.500355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ca4b4-942f-4500-a307-28fc6a5cdcf9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.542727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:39.543406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.543730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.544013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.544783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] RBAC: Adding query filter params (name=member) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:39.545097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:39.546569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f000-5f8d-401c-8e78-e698e1fa7f98 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:39.558089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 193/398] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:39.563979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.611727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce53c3c-6d67-4595-962e-f3315e3cee4b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.612070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce53c3c-6d67-4595-962e-f3315e3cee4b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.612294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce53c3c-6d67-4595-962e-f3315e3cee4b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.614120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 194/399] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:39.627486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.627790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.628072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.664339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:39.665584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:39.705793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01f609-f5b5-49a5-85f8-20e28f65d1d0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.766639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:39.767419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:39.767740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:39.767860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 195/400] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:39.768019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:39.769258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:39.770725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:39.772908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 206/401] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:39 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:39.777714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.799276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:39.935709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dba2-de7f-4cbc-8952-741a429cc0c7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:39.965504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da5ec-92f9-4cb9-bb72-9ff226c5eb72 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.002971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.003876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.004159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.004441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.005660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.007194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a969682-dd35-4f5f-98d3-76194850d531 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.015364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 196/402] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:39 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.015364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc626ad-bf48-427a-bb8f-ab63bba43d49 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.015364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc626ad-bf48-427a-bb8f-ab63bba43d49 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.015364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc626ad-bf48-427a-bb8f-ab63bba43d49 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.018829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 197/403] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:40.019653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc626ad-bf48-427a-bb8f-ab63bba43d49 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.022653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.023765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.024189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.024601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.037160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:40.044495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6ddace20-bc02-4ce8-863e-636949705172 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:40.050975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 207/404] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:40.052321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.052666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.052953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.070951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:40.072562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:40.143008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc626ad-bf48-427a-bb8f-ab63bba43d49 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.155549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 208/405] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:40.156736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.198674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.199919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.200376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.200849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.203102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, group_id=050ee54bc6e44e2d8ea1d32cf6db1d12, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.204840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.281584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae834a-8f04-46a2-be7f-a36ded1d041d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.312491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 198/406] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Feb 28 12:44:40 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:40.315054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.316533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.317324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.317616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.318103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.318707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:40.319112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.320927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.330346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 209/407] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.336224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.440793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06bcdb-5b4e-4b02-b859-df8dcfbf0eac None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.465068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645e56-3020-452c-889a-74f7fa4252b8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.485107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.485945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.486233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.486509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.500613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:40.503907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.505020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.505549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.506042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.507447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.507660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:40.509386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.512212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 210/409] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.512371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 199/409] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:40.515258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.518009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.625179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cd61e-fce4-475a-a5c2-91ccf85cd3d2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.670939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.671665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.671955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.672413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.673173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:40.673482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.674871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.675672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4e872-af0e-4425-82b7-64a201ec3b69 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.685483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 200/410] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.691890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.713329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.714188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.714479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.714766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.715984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.717468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.719464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 211/411] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.725026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.819339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c89bb3-14df-41c6-b098-a9ddd1fb8afb None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.849573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0bd-d28b-421f-9a13-8031f351ea78 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:40.860430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.861680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.861970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.862247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] PATH_INFO: `/v3/groups/6843626cf6264ba2a384593aa20d76e9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.863836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] RBAC: Authorizing `identity:get_group(group_id=6843626cf6264ba2a384593aa20d76e9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.865581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.868287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 201/412] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/groups/6843626cf6264ba2a384593aa20d76e9 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:40.880686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:40.897692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:40.898876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:40.899345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:40.899839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/6135515bbd37458794241e7a2844577e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:40.906571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d34ee1df142f0b05d15d0e671b700, group_id=050ee54bc6e44e2d8ea1d32cf6db1d12, role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:40.908287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:40.989153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 212/413] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Feb 28 12:44:40 2022] PUT /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700/groups/050ee54bc6e44e2d8ea1d32cf6db1d12/roles/6135515bbd37458794241e7a2844577e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:44:41.010501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd18e-9184-4b13-8718-cafd91bbb9a4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:41.051503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:41.052491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:41.052788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:41.053073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] PATH_INFO: `/v3/projects/a00bab95afbd472db33af396a6aecd67` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:41.060072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] RBAC: Authorizing `identity:get_project(project_id=a00bab95afbd472db33af396a6aecd67)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:41.062206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dc94b-50da-46df-a890-001dc9afa636 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:41.064133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 202/414] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:40 2022] GET /identity/v3/projects/a00bab95afbd472db33af396a6aecd67 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:41.070045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:41.203388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57540f74-cc7a-473e-b248-58430d01751d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:41.249880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:41.250766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:41.251054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:41.251335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] PATH_INFO: `/v3/projects/a00bab95afbd472db33af396a6aecd67/groups/6843626cf6264ba2a384593aa20d76e9/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:41.254389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] RBAC: Authorizing `identity:create_grant(project_id=a00bab95afbd472db33af396a6aecd67, group_id=6843626cf6264ba2a384593aa20d76e9, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:41.255884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b373f6-d1a2-45d8-a0bb-6a6b2416f55e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:41.396220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 213/415] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Feb 28 12:44:41 2022] PUT /identity/v3/projects/a00bab95afbd472db33af396a6aecd67/groups/6843626cf6264ba2a384593aa20d76e9/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:44:41.688545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea1c7-8f7d-40db-bc76-0d971ea2cca6 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:41.688919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea1c7-8f7d-40db-bc76-0d971ea2cca6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:41.689121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea1c7-8f7d-40db-bc76-0d971ea2cca6 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:41.691264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 203/416] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:41.697067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:41.697360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:41.697642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:41.720557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:41.721780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:41.799312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 214/417] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:41.848943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea1c7-8f7d-40db-bc76-0d971ea2cca6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:41.985131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea1c7-8f7d-40db-bc76-0d971ea2cca6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:42.032723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:42.033533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.033824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.034105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.048331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:42.055370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-66319ae7-e3ad-4ee9-9884-624ddfe8973a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:42.056947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 204/418] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:42.062552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:42.201974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729111f-7cdb-4752-a8ce-6d1ed58147f0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:42.237316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21cb6-f7e6-43e3-adb0-4f36a4fd1763 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.237630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21cb6-f7e6-43e3-adb0-4f36a4fd1763 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.237869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21cb6-f7e6-43e3-adb0-4f36a4fd1763 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.239655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 205/419] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:42.244446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.244734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.245011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.258628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:42.259295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.259622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.259901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.260646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:42.260950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:42.262328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:42.272496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:42.273678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:42.278863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 215/420] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:42.284593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:42.402066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 206/421] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:42.438981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:42.455016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e8410-db1b-4ad6-8c13-6aba7513a946 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:42.516713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:42.517892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.518404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.518884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.545897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3643-68ec-4df3-856f-308d1113a4a7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:42.609523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:42.610626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.611090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.611632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.626615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:42.634770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:42.643833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 207/422] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:42.644790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:42.646498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:42.649277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:42.790245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a02fb-b84c-4daa-9357-89ff8b57bc71 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:42.828984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:42.829965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:42.830416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:42.833727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:42.833727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:42.833727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:42.834709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:42.844637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 216/423] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:44:42.845145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 208/424] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:42.850487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:42.850806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.011013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1ef44-e4ac-4590-afe6-e4925bde3bd0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.027099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8797-b387-4b6c-ac53-de6e51168d9c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.046637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.047833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.048322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.048798 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.050239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.051900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.054060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 217/425] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:43.060646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.099098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.100428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.100895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.101351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.179350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.181832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.259043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae3c1-c323-4659-acc0-e8cd42945d42 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.330329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 209/426] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:44:43.334925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.334925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.334925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.334925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.335601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.336527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.337049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.340310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 218/427] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:43.350385 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.475453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0758a0-ab91-4c4b-9419-eac3505c98cc None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.495450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82f6fb-d280-4a30-99b8-f2a896499374 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.510076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.511261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.511818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.512345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] PATH_INFO: `/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.513793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] RBAC: Authorizing `identity:get_project(project_id=f7fff96d7f7d4a84b0510d204e7a1e36)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.515566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e43a7-3cc0-4a6c-b767-ebb48e611b9b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.517983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 210/428] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/projects/f7fff96d7f7d4a84b0510d204e7a1e36 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:43.523654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c18a-43bc-4c46-9c3a-d87b39c430f8 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.524221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c18a-43bc-4c46-9c3a-d87b39c430f8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.524731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c18a-43bc-4c46-9c3a-d87b39c430f8 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.526908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 211/429] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:43.527857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77c18a-43bc-4c46-9c3a-d87b39c430f8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.538392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.539058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.539346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.539662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.540495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:43.541181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.542968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84fbac-4018-4396-aa46-a93b4551a9aa None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.559504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 219/430] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:43.559504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.559504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.559504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.584367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:43.585523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:43.736989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77c18a-43bc-4c46-9c3a-d87b39c430f8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.742395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 220/431] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:43.768012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.779234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.781617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.782136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.782609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.784108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.785735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.787594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 212/432] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:43.793784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.897308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1f8a2-126c-4232-b87c-5e1d5b38dc99 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.926099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285369b7-9121-4a5d-b4f4-a5ed58187fdf None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:43.938292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.939087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.939372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.939692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.953165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:43.961098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-5b6529fb-c592-4efa-a567-1fa2acdafd96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 12:44:43.963669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 221/433] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:43.963669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d36c-38a5-4f87-818e-c65c88d6dc2b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.963885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d36c-38a5-4f87-818e-c65c88d6dc2b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.964124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d36c-38a5-4f87-818e-c65c88d6dc2b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.965907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 222/434] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:43.971024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d36c-38a5-4f87-818e-c65c88d6dc2b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:43.983828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:43.984498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:43.984790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:43.985075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:43.985913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=6135515bbd37458794241e7a2844577e, scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:43.986234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:43.987760 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc19c17-e64f-410d-b5b1-714f8666bf1e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:43.998902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 213/435] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=f7fff96d7f7d4a84b0510d204e7a1e36&role.id=6135515bbd37458794241e7a2844577e => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:44.000103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96efec-255a-45a1-a404-2ae288e2babf None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.000397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96efec-255a-45a1-a404-2ae288e2babf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.000680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96efec-255a-45a1-a404-2ae288e2babf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.028121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-7d96efec-255a-45a1-a404-2ae288e2babf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:44.029542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7d96efec-255a-45a1-a404-2ae288e2babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:44.109622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d36c-38a5-4f87-818e-c65c88d6dc2b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.122272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 214/436] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:44.145637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4a0a-0a85-4877-a1a9-e34b4a3a4b61 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.146278 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4a0a-0a85-4877-a1a9-e34b4a3a4b61 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.146755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4a0a-0a85-4877-a1a9-e34b4a3a4b61 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.149359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 215/437] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:44:44.154196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4a0a-0a85-4877-a1a9-e34b4a3a4b61 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.156077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.156768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.157054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.157332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.158098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] RBAC: Adding query filter params (name=member) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:44.158404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.160652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4f6fe-fef1-4413-b5b2-33b3025e82bd None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.173270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 223/438] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:44:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:44.173270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.173270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.173270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.190814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:44.192082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:44.262992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 224/439] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:44.263946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.293117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4a0a-0a85-4877-a1a9-e34b4a3a4b61 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.335238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.336108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.336396 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.337583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.349625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:44.356997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:44.358543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 216/440] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:44.359327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.375007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee30a-e01e-40ed-81e4-9a970e6023b2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.411863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.412432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.412719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.412998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.466462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1daab-45a2-45dc-a911-074c10b14cf5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.478363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.479859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.498042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.499394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.499710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.499997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.509657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:44.516653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:44:44.518021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 217/441] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:44.518617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.576115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 225/442] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:44.576960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.611620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2926217-cf51-40d7-8cf5-9cfada571a77 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.642895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.643586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.643869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.644149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.644894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:44.645204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.646583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.654060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 218/443] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:44.654858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.667331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169aeee-c52e-43d0-a60a-614bbdf9a2e4 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.699245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.699914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.700198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.700470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.701231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:44.701560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.702924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.710438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 226/444] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:44.711192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.748038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c3856-e4eb-4d35-ae3c-b3889cec95df None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.779301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446603-0599-420c-bb94-99da4194b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.780191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446603-0599-420c-bb94-99da4194b71b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.780478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446603-0599-420c-bb94-99da4194b71b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.780752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446603-0599-420c-bb94-99da4194b71b None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.781932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30446603-0599-420c-bb94-99da4194b71b None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.783375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30446603-0599-420c-bb94-99da4194b71b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.785072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 219/445] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:44.785821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446603-0599-420c-bb94-99da4194b71b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:44.801304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf0567-3949-4fce-b2ea-be2879c8fe65 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.832465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.833092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.833372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.833646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.878956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446603-0599-420c-bb94-99da4194b71b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:44.895276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.896766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.910756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:44.911389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:44.911704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:44.911983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:44.975247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:44.976742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:44.994160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 227/446] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:44.994160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.074027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 220/447] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:45.074847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.081555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b931-36e8-4b2a-92dc-0e6d9f55011b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.114207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.115126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.115417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.115723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.116871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.118307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.119913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 228/448] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:44 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.120653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.172045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1345-3e3d-4bfe-87d5-1af39e28d5dd None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.203945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.204723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.205010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.205288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] PATH_INFO: `/v3/projects/7c8d34ee1df142f0b05d15d0e671b700` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.206459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] RBAC: Authorizing `identity:get_project(project_id=7c8d34ee1df142f0b05d15d0e671b700)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.208002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.209659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 221/449] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/projects/7c8d34ee1df142f0b05d15d0e671b700 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.210411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.211815 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669c904-845b-4218-a003-6374ed2e663c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.243897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.244738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.245019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.245292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] PATH_INFO: `/v3/projects/a00bab95afbd472db33af396a6aecd67` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.246466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a00bab95afbd472db33af396a6aecd67)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.247947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.249606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 229/450] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/projects/a00bab95afbd472db33af396a6aecd67 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.250349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.302221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1053e4-1a01-4a0f-9911-9c80d7c98f64 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.334060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.334701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.334989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.335268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.336125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=8f80caecbcc747418e3bf59033daf4ab, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:45.336441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.337874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.343990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 222/451] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=8f80caecbcc747418e3bf59033daf4ab => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.344746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.346425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63fde9-7ba5-4c8e-a422-5ec648d600c6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.381856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.382728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.383016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.383296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] PATH_INFO: `/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.384612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] RBAC: Authorizing `identity:get_group(group_id=050ee54bc6e44e2d8ea1d32cf6db1d12)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.386110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.387994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 230/452] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/groups/050ee54bc6e44e2d8ea1d32cf6db1d12 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.394526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.447592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca542ee3-e210-43f2-87f9-cd1e42678bf7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.483226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.484045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.484328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.484602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] PATH_INFO: `/v3/groups/6843626cf6264ba2a384593aa20d76e9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.485815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] RBAC: Authorizing `identity:get_group(group_id=6843626cf6264ba2a384593aa20d76e9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.487291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.489124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 223/453] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/groups/6843626cf6264ba2a384593aa20d76e9 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.495160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:45.507269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb66b1-f786-4056-8217-84519e382d1d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.541748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.542432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.542721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.543018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.543973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] RBAC: Adding query filter params (group.id=050ee54bc6e44e2d8ea1d32cf6db1d12, role.id=6135515bbd37458794241e7a2844577e, scope.project.id=7c8d34ee1df142f0b05d15d0e671b700) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:45.544192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.546197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564e6ab-60f5-441e-b373-a3e58bf49372 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.552346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 231/454] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/role_assignments?group.id=050ee54bc6e44e2d8ea1d32cf6db1d12&scope.project.id=7c8d34ee1df142f0b05d15d0e671b700&role.id=6135515bbd37458794241e7a2844577e => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:45.605639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75094ca3-501b-4818-adcf-3d8126237faa None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:45.642793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:45.643589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:45.643810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:45.644093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:45.644945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] RBAC: Adding query filter params (group.id=6843626cf6264ba2a384593aa20d76e9, role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=a00bab95afbd472db33af396a6aecd67) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:45.645263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:45.646759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7842d-892b-488f-bb2c-48bea5feaa64 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:45.653427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 224/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Feb 28 12:44:45 2022] GET /identity/v3/role_assignments?group.id=6843626cf6264ba2a384593aa20d76e9&scope.project.id=a00bab95afbd472db33af396a6aecd67&role.id=02948fe3aa224688a909554882ca78f6 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:48.363525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382f63-e08a-46dc-a20a-b86899b590a9 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.364030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382f63-e08a-46dc-a20a-b86899b590a9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.364105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382f63-e08a-46dc-a20a-b86899b590a9 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.366137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 232/456] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:48.371223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f9a-aa43-460f-aace-195b222e0eca None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.372086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f9a-aa43-460f-aace-195b222e0eca None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.372571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f9a-aa43-460f-aace-195b222e0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.396463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-dd058f9a-aa43-460f-aace-195b222e0eca None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:48.398035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dd058f9a-aa43-460f-aace-195b222e0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:48.475495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 225/457] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:48.514464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382f63-e08a-46dc-a20a-b86899b590a9 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:48.669435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382f63-e08a-46dc-a20a-b86899b590a9 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:48.716707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459b37-66c4-478e-b923-557dcaf37eb5 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.717464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:48.717709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459b37-66c4-478e-b923-557dcaf37eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.717897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459b37-66c4-478e-b923-557dcaf37eb5 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.718114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.718414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.718668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.721498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 226/458] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:48.726170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.726462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.726739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.738321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:48.739812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:48.757379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:48.758565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:48.768975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:48.770193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 233/459] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:48.776221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:48.866620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 227/460] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:48.902392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:48.950940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35494d29-e4bf-457d-8901-c74e7f1e7305 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:48.992130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:48.992797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:48.993076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:48.993347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:48.994070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:48.994377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:48.995793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a06873-734e-436d-8072-f9548cc9dfe4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.010588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 234/461] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:49.012257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95c229-bf37-4c85-9fd5-0523d8ca6839 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.012771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95c229-bf37-4c85-9fd5-0523d8ca6839 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.013641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95c229-bf37-4c85-9fd5-0523d8ca6839 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.021039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 235/462] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:49.021039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95c229-bf37-4c85-9fd5-0523d8ca6839 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.043598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83587e-6ea8-45c4-b49f-19b37aa84767 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.077338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb623520-3167-4213-9850-78ab412236ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.078302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb623520-3167-4213-9850-78ab412236ae None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.078628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb623520-3167-4213-9850-78ab412236ae None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.078903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb623520-3167-4213-9850-78ab412236ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.089482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb623520-3167-4213-9850-78ab412236ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.090937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb623520-3167-4213-9850-78ab412236ae None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.108260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-fb623520-3167-4213-9850-78ab412236ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:49.109696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 228/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:49.110992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.111280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.111575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.129248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:49.130468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:49.143095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95c229-bf37-4c85-9fd5-0523d8ca6839 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.175350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.176122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.176735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.176735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.177376 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.178834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d03758-2e59-4b69-adbd-4f4ec40119e2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.202405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 229/464] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:49.203265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.292344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 236/465] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/users => generated 246 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:49.294063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8879f-44e7-46b6-9a94-897af7d144e9 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.294463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8879f-44e7-46b6-9a94-897af7d144e9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.295172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8879f-44e7-46b6-9a94-897af7d144e9 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.301456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 237/466] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:49.301456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8879f-44e7-46b6-9a94-897af7d144e9 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.301699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bea9d-e61e-49f8-8948-17da147e8562 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.350899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.352048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.352558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.353054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.355217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:49.355831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.357578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8aca1-cec5-48f3-9ea6-76812594a7c9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.371122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 230/467] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:49.373011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.374515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.375014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.393414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:49.395028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:49.427091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8879f-44e7-46b6-9a94-897af7d144e9 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.464730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.465512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.465793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.466066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.468362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 231/468] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:49.469418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.478103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.479730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.498019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:49.499861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:49.505653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.571566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c516b6-dd50-417f-9c20-e6b93eda52f3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.605871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.606543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.606823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.607217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.607928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.609328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.612608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4cea1-b866-4975-85f6-7d94f04a9337 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.645357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.646144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.646420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.646689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.656927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.658378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.674310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:49.678239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 239/470] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:49.678239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.695853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 232/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:49.697102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.882431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b022e-9327-41a2-b9bc-d641b61484f0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.911964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda9689-41c2-46b1-9f45-a80446b0556a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:49.932549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.933332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.933712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.934085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.934916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:49.935635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.937437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.950257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 240/472] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:49.956717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:49.960337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:49.961268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:49.961746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:49.962235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:49.963155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:49.963694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:49.965285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:49.978557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 233/473] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:49.984617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:50.077982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30c86-1e45-4386-90ce-fd7c0a5d1dc2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:50.097583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5a9b-6be3-47b5-a64a-18abab8c4a5d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:50.119607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:50.120270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.120551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.120824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.121533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:50.123063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c96e7-c6ac-44dd-8016-86f630268649 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:50.137640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:50.138775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.139121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.140637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.140637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:50.141849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:50.236359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 241/474] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:50.238202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081265f4-7e39-4296-9894-10a9b542bbef None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.238691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081265f4-7e39-4296-9894-10a9b542bbef None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.239277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081265f4-7e39-4296-9894-10a9b542bbef None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.241665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 242/475] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:50.249257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.249257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.249257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.267506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 234/476] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:49 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:44:50.272739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:50.274423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:50.381452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 243/477] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:50.422557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:50.537342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d7c5-afa3-41cd-84b6-30df3b117697 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:50.571309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:50.572015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.572361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.572639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.573461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:50.574892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:50.612592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.sql.core [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 28 12:44:50.612592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 12:44:50.612592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [parameters: {'id': '59ef74b6ef3442e489bbe82ff98baf54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 12:44:50.612592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79576) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 12:44:50.627812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 12:44:50.629478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 235/478] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Feb 28 12:44:50 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:50.636282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:50.738893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52f031-4f40-4041-aaa6-338599f95368 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:50.804209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:50.805033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:50.805319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:50.805596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:50.822982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:50.838960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6cfee205-fb9e-4f90-877d-b62d6a10e2c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 12:44:50.840546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 244/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:44:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:50.850697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:50.995852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c576df3-42a3-4e1c-8a5d-276ab5b9cc8d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:51.031509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:51.031509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:51.031509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:51.031509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:51.032072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:51.032369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:51.033762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bee773-ab9f-44c7-9c76-64673cf76b00 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:51.042201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 236/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:52.117614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874c19-26c1-4efa-9749-a32bd26f6136 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.117614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874c19-26c1-4efa-9749-a32bd26f6136 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.117614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874c19-26c1-4efa-9749-a32bd26f6136 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.118671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 245/481] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:52.122799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.123200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.123599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.147428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:52.148650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:52.245445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 237/482] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:52.288974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874c19-26c1-4efa-9749-a32bd26f6136 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:52.421178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874c19-26c1-4efa-9749-a32bd26f6136 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:52.468189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:52.469444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.469933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.470406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.484433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:52.499921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-7e70e1d6-7fbc-4acf-9322-00e020b74acf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:52.501729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 246/483] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:52.508581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:52.623886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bba6-8b91-4b8c-925b-ffa43fbd1d8f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.624488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bba6-8b91-4b8c-925b-ffa43fbd1d8f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.624976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0bba6-8b91-4b8c-925b-ffa43fbd1d8f None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.627198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 247/484] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:52.640603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.641201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.641556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.651253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760d7ea-e5fe-4522-b3bb-ccc94fe2ba98 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:52.673708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:52.677411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:52.721201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:52.722332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:52.722954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:52.723403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:52.724342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:52.724820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:52.726404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:52.748342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 238/485] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:52.760970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:52.810493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 248/486] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:52.847140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:52.958998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f139c-5d54-4573-880f-247203c0f51d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:52.996640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e65959-c59b-4a97-bec8-dba350ac0edf None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.031914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.033028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.033581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.034328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.041044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.041846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.042135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.042416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.048211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:53.055368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:53.057149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 249/487] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:53.062326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.068463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.070214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.094875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:53.101114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 239/488] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:53.103068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.203029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce34e1-2204-4f42-ab22-78e8a88c94b3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.236967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.237989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.238487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.238955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.239920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:53.240420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.241997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.251293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 250/489] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:53.256285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.265975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c672-35a4-4ef7-92fc-bbdc2b29b594 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.299979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.301035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.301514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.302000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.302959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:53.303491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.305075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a8965-2108-48a1-b187-691d59321cca None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.323190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 240/490] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:53.324983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3797e-c6ca-4c11-b708-8b7e64b97b6d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.325491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3797e-c6ca-4c11-b708-8b7e64b97b6d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.325960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3797e-c6ca-4c11-b708-8b7e64b97b6d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.329144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 241/491] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:53.330099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3797e-c6ca-4c11-b708-8b7e64b97b6d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.359171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad276-8c67-4109-ad84-f39d086fd110 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.394684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.395493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.395800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.396081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.406360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.407843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.423708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1730704b-afc7-4f29-9ddd-0869dda003bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:53.424903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 251/492] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:53.426069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.426356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.426636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.432927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3797e-c6ca-4c11-b708-8b7e64b97b6d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.443530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:53.444704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:53.467523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.468318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.468599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.468873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.476067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.477513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.491742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2debc980-2df8-4d32-9afc-51cbeb66b915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 242/493] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721279-f194-4f89-bc78-8f7af12e09ae None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721279-f194-4f89-bc78-8f7af12e09ae None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4721279-f194-4f89-bc78-8f7af12e09ae None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 243/494] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:53.497246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721279-f194-4f89-bc78-8f7af12e09ae None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.527494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 252/495] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:53.527494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.611824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4721279-f194-4f89-bc78-8f7af12e09ae None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.617841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ce6d7-8379-48d5-8f4f-f5ea16cd9baf None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.646465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.647205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.647604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.647885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.648603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:53.648933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.650343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291fb1-9a85-4b75-b97d-6ea17584e3e6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.651762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.652775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.652775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.653016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.653804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:53.654115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.655605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.665841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 244/496] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:53.665841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.665841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.665841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.681248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:53.682432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:53.698338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 253/497] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:53.698338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.753363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 245/498] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:53.754497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.813083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366d358-b158-490b-a136-80ae3f04760e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.848354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.849323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.849955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.850243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.858532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dcbb0-961b-4f13-8514-812f61a6e542 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:53.861008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:53.870041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:53.870041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 254/499] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:53.870299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.896823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:53.897857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:53.898145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:53.898425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:53.906067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:53.907569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:53.922360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 12:44:53.928211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 246/500] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:53.928211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:53.975331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54a142-f49a-487d-b387-52b584e42601 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.008728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.009383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.009922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.009922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.031927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c91-c4d8-42b8-8ce8-716155315bc0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.067052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.067870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.068152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.068426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.076151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.077654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.078733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:54.085822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:54.087009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 247/501] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:54.088026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.178377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 255/502] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:54.179127 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.188289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c001b-a1ab-4f35-9918-20fd40eeed7c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.220890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.221553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.221840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.222120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.222862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:54.223255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.224594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.232174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 248/503] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:54.232988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.270627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfce921-14ab-4ae8-bf03-fd1da184ea85 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.302157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.302831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.303108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.303390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.304254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:54.304571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.306017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3b617-d53b-46c6-bb16-ca8811e704c8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.322404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 256/504] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:54.323671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3adf5-594f-4105-a70e-0df1ddb39b86 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.323964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3adf5-594f-4105-a70e-0df1ddb39b86 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.324249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3adf5-594f-4105-a70e-0df1ddb39b86 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.325907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 257/505] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:54.327172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3adf5-594f-4105-a70e-0df1ddb39b86 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.329877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f0c9-48e0-4d87-ac39-b75b3543e701 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.362703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.363357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.363670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.363951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.364681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:54.364985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.366357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.373852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 249/506] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:54.374614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.421417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3adf5-594f-4105-a70e-0df1ddb39b86 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.453350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.454059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.454342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.454615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.464030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.465485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.466532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825a84f-9ff4-49e9-ab5a-22315bb2a8aa None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.482563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:54.483731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 258/507] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:54.484484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.498271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.499053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.499340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.499647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.510366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.511872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.528023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-27f1a799-573d-4291-b154-a0ecb2129ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:54.529179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 250/508] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:54.530887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b840e-3929-4237-89bf-5777690667ef None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.531177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b840e-3929-4237-89bf-5777690667ef None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.531460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b840e-3929-4237-89bf-5777690667ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.547142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-432b840e-3929-4237-89bf-5777690667ef None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:54.548363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-432b840e-3929-4237-89bf-5777690667ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:54.578506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945581-eaf5-4e72-b930-62356c1e4c48 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.609708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 251/509] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:54.609864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.610490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.610589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b840e-3929-4237-89bf-5777690667ef None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.610780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.611060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.674289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.675788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.703165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b840e-3929-4237-89bf-5777690667ef None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.734623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.735350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.735666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.735941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.745427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.746876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.763512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:54.770219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 252/510] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:54.770219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.770467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 259/511] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:54.770467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.860111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31217136-8bc4-47f7-b631-1749c2d918de None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.862199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32203c-180e-468a-9338-44fe38c6a3a9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:54.892462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.893114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.893400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.893683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.894402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:54.894713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.894896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:54.895566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:54.895857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:54.896126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.896213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:54.896849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:54.897160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:54.898535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:54.906759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 260/512] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:54.907569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:54.913404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 253/513] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:54.913404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.002593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f178-b377-46bf-b9da-8a60d5e5375b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.003329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9005a-bc8d-4a50-98ab-a8efc663ac29 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.033323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.034094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.034374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.034520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.034644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.035172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.035459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.035774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.036489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.036800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.038186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.044540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.046505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.049880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 254/514] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.050657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.062811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:55.063992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 261/515] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.064747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.141818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bedf-ec7a-49f7-9fcb-a9322453e9e9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.160368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126a79d-74c9-4c00-a9dd-dcae8b7bdd72 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.173885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.174684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.174962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.175232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.184593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.186635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.192399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.193170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.193452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.193726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.200736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.202276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.202690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:55.203868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 255/516] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.204675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.216235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 12:44:55.217436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 262/517] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.218193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.296915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21016833-bef9-4624-b25f-6ea9e569dd58 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.309692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22703a39-d17c-475d-a3f2-8434836823dd None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.328874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.329649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.329935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.330406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.336753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.338218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.341268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.342646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.342929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.343208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.350317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.351377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:44:55.351775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.352564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 256/518] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.353324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.365683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 12:44:55.366857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 263/519] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.367649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.450562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f838a-51eb-4110-a26e-317cc344b3b2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.459528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea824-35cd-4a84-b57f-ce454258e25a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.481987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.482661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.482954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.483232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.483978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.484290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.485676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.490140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.490775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.491063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.491344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.492089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.492402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.493761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.496966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 257/520] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.497743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.506006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 264/521] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.506813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.593829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf24b3-afdb-4e61-a753-ce8e36fdbb1f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.597926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f31d-032f-4996-97cf-916a4f853086 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.625417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.626130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.626418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.626697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.627554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.627863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.629292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.629420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.630026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.630314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.630592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.631372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.631713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.633138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.650507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 265/522] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.651292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.669099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 258/523] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.669099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.747495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3deead-5aee-4ec5-b211-61c1cf89d66f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.758927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643da347-2d85-44cd-a8fd-2f0f114a3814 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.778766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.779451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.779763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.780036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.780862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:55.781173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.782614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.791832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.792487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.792773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.793051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.793748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.795727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.799056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 266/524] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:55.799859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.891513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceccc12-5687-4cb4-8026-df7d9419aa43 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:55.903167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 259/525] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:44:55 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:44:55.904097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:55.926573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:55.927444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:55.927767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:55.928044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:55.936760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:55.938300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:55.954783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:44:55.960787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 267/526] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:55.960787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.021659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295054fa-0e4d-4d8d-b613-8e147cf097a9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.062106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.062779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.063068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.063350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.064251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:56.064570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.064885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125c9a-25fc-4178-b1dd-a4a5b2745047 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.066059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.077620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 260/527] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:56.077620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.113952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.114617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.114904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.115184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.194021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.194197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e42a-0549-4a60-8ab9-9ff0d938c3f8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.195799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.230611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.231276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.231587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.231866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.298951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 268/528] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:56.299905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.304948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.306797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.398062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b450d6-5eae-4fef-938d-ec95a8da8911 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.412632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 261/529] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:44:56.414272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.434109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.434770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.435056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.435333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.436180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:56.436490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.438013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.450194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 269/530] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:56.450945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.517267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea274f0b-a63e-4455-88e1-55a4a7530af1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.550277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddac93-0f62-4780-be92-9a38160f4afa None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.551772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.552787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.553272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.553766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.564230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.565943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.583620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:56.583745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.584526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.584811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.585089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.586236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 262/531] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:56.587267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.596153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.597613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.613892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:56.619458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 270/532] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:56.619458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.694122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cb20-3be5-4465-a0d2-003f6d8c1680 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.716201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598d9c-b6c8-43f2-89fc-9bfeb8dab5dd None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.730301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.731316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.731831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.732365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.733386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=b8d34ef4b64a42a897fa75e8b14c60f3) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:56.733922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.735666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.741864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 263/533] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/role_assignments?user.id=b8d34ef4b64a42a897fa75e8b14c60f3&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:56.742979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.754233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.755229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.755229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.755436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.756189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:56.756498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.757878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.771317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 271/534] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:56.776567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.850342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96988-f5cb-4f4d-8e24-41aeb5f2f6a4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.894121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.895114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.895684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.896176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.897202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:56.897780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.899428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.916885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c23fb-8c55-4bc9-a754-9ecea20427a8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:56.917339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 264/535] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:56.918886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:56.954435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21720938-88c3-4559-8194-27851830b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:56.955253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720938-88c3-4559-8194-27851830b03c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:56.955563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720938-88c3-4559-8194-27851830b03c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:56.955990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720938-88c3-4559-8194-27851830b03c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:56.963791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21720938-88c3-4559-8194-27851830b03c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:56.965852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21720938-88c3-4559-8194-27851830b03c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:56.980791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-21720938-88c3-4559-8194-27851830b03c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:44:56.982300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 272/536] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:56.987454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21720938-88c3-4559-8194-27851830b03c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:57.090157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76ec6-65a5-4095-a72e-0e1caa768808 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:57.108562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21720938-88c3-4559-8194-27851830b03c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:57.131741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:57.132597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:57.132888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:57.133168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:57.143496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:57.143496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:57.150621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:57.151271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:57.151573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:57.151847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:57.152633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:57.152939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:57.154405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:57.164683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:44:57.165887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 265/537] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:57.176503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 273/538] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:57.177235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:57.183113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:57.286280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3675-5d2a-4c0c-9aa5-61dd7e368ee0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:57.329716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:57.330803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:57.331329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:57.331856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:57.332852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:57.333370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:57.335053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:57.355067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348456aa-4fd8-4011-8754-20b3f57fb3e8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:57.374479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 266/539] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:57.386100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:57.397333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:57.397995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:57.398277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:57.398814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:57.399371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=ac94b28422044aed9681b0c31b9ab97e) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:57.399714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:57.401164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e7d20-cad6-4ec8-b5d3-d1217b28d1d9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:57.416453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 274/540] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:57 2022] GET /identity/v3/role_assignments?user.id=ac94b28422044aed9681b0c31b9ab97e&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:44:57.501824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d780f-70f0-4544-baa9-2b1ec82fe6dc None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:57.543029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:57.543655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:57.543944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:57.544223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:57.545623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=6793eba624e644a9ba49910428cdb515) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:57.545939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:57.547423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a3fb-0ab3-46a7-9a6c-04c4a78ba1d2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:57.554079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 267/541] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:44:57 2022] GET /identity/v3/role_assignments?user.id=6793eba624e644a9ba49910428cdb515&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:58.725884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57e07-45b8-41fb-9a49-476af4fa977e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:58.726897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57e07-45b8-41fb-9a49-476af4fa977e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:58.727389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b57e07-45b8-41fb-9a49-476af4fa977e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:58.729656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 275/542] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:58.735545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352825d-a068-467e-a521-afe178eee862 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:58.736374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352825d-a068-467e-a521-afe178eee862 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:58.736876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352825d-a068-467e-a521-afe178eee862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:58.754099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9352825d-a068-467e-a521-afe178eee862 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:58.755639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9352825d-a068-467e-a521-afe178eee862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:58.829488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c919f7f-62f3-404a-96fb-8be49cff511f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:58.829775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c919f7f-62f3-404a-96fb-8be49cff511f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:58.830072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c919f7f-62f3-404a-96fb-8be49cff511f None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:58.832096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 276/543] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:58.837129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:58.839169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:58.839169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:58.849084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 268/544] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:58.855348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:58.856599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:58.893838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352825d-a068-467e-a521-afe178eee862 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:58.929524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 277/545] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:44:58.953990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.019836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352825d-a068-467e-a521-afe178eee862 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.052099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789d4d6-e6be-4a1f-a32e-4f5cf992d906 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.062534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.063343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.063656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.063940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.088166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:59.097382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.098191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.098480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.098759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.105482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:59.106778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 269/546] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:59.111961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:44:59.118962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:44:59.120391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.135098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 278/547] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:59.138034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.268509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee28b-dea9-456c-b211-db2f199b6c24 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.318085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9788d8-a811-4638-ac0b-5ef00536d533 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.341650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.342322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.342619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.342934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.343713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:59.344025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.345428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.360421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:59.365961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.366647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.366936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.367222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.368007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:59.368322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.369706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.372111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.389966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 279/549] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:59.404947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.502853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9de589-db0d-446f-825e-c2c7ef7af21d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.545977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.546791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.547078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.547354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.572267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.574506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.591018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92246-aa98-4ab9-8735-84c8c9eb4393 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.591437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-4714c0d4-896a-496e-8148-db3e416dcc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:59.593095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 271/550] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:44:59.594773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f578-72af-4162-ad3c-54995968c59d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.594773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f578-72af-4162-ad3c-54995968c59d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.594951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f578-72af-4162-ad3c-54995968c59d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.600515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 272/551] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:44:59.601354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f578-72af-4162-ad3c-54995968c59d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.628135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.629278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.629767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.630264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.640946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.642660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.659130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-254becfc-e1a3-4ad0-86b9-f165af31badc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:44:59.665197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 280/552] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:59.666680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.667200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.667708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.685005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:44:59.687099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:44:59.710691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f578-72af-4162-ad3c-54995968c59d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.744995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.745785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.746018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.746304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.747078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:59.747392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.749471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.760092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 281/553] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:44:59.761579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.763521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 273/554] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:59.766936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.870271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9c50-82aa-47a3-abbd-0e34f4aa1779 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.872452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4285f-4519-4f14-8181-8f296c947044 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:44:59.905570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.906233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.906521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.906802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.907567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:44:59.907905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.909579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.909944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:44:59.910946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:44:59.911436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:44:59.911953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:44:59.920448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:44:59.921839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 282/555] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:44:59.922538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:44:59.922646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:44:59.937683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:44:59.939605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 274/556] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:44:59.940603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.027569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97311f9-6dc1-4a98-82ac-3f04915c8283 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.053837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc99fa-9be0-4308-ad3c-2dd5dc259d46 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.064435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.065155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.065448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.065735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.076623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:00.083451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:00.085084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 283/557] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:00.085882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.092988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.094081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.094575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.095063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.103026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.104754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.119558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:00.121388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 275/558] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:44:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:00.122578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.186245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9b0b3-ba57-4188-948f-68e8e1b0be23 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.222059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7804f-99c5-453a-bdac-55dcf91dca57 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.222482 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.223149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.223465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.223758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.224778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:00.224886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.226336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.247414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 284/559] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:00.247414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.259146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.259848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.260212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.264217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.264217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:00.264217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.264217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de09756-bed0-4b56-9bf4-a8866d7fab43 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.271339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 276/560] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:00.272630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2de5-c34e-495e-9cf8-7d1c9ed844a6 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.272918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2de5-c34e-495e-9cf8-7d1c9ed844a6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.273197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2de5-c34e-495e-9cf8-7d1c9ed844a6 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.274997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 277/561] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:00.280065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f2de5-c34e-495e-9cf8-7d1c9ed844a6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.353558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd511bd-a14b-4269-9598-810073a4f1ca None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.379626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f2de5-c34e-495e-9cf8-7d1c9ed844a6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.386918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.387621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.387912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.388193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.389568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:00.389882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.391327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.413084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 285/562] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:00.413084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.417433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.418256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.418539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.418813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.429000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.430461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.446187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ebb4041a-e0fc-4b79-b259-e9c5c36b1005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:00.447507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 278/563] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:00.448496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27637-c2d7-4ac0-80ce-8b5e4fedf6ba None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.448779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27637-c2d7-4ac0-80ce-8b5e4fedf6ba None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.449054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27637-c2d7-4ac0-80ce-8b5e4fedf6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.465342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-85c27637-c2d7-4ac0-80ce-8b5e4fedf6ba None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:00.466512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-85c27637-c2d7-4ac0-80ce-8b5e4fedf6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:00.502037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ba8e0-572b-420f-83f6-82601c7734bc None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.528813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 279/564] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:00.530501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d833-9dac-4ebc-9d9f-d0cd9e349085 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.530790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d833-9dac-4ebc-9d9f-d0cd9e349085 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.531066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d833-9dac-4ebc-9d9f-d0cd9e349085 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.532727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 280/565] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:00.533419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d833-9dac-4ebc-9d9f-d0cd9e349085 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.544396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.545188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.545481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.545764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.556529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.558018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.574995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:00.576692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 286/566] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:00.577438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.631124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d833-9dac-4ebc-9d9f-d0cd9e349085 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.662582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.663221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.663530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.663830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.668301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac92cc-6958-4e96-8ad7-e2fe654c392e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.699682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.700314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.700592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.700861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.702115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:00.702423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.703808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5997-70fc-462f-b68c-73d83b9d23cb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.714703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 287/567] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:00.715889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.716177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.716453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.727915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.729388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.733121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:00.734302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:00.794469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 288/568] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:00.795839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.826669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 281/569] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:45:00.826669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.889342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297c66-d4d0-451a-beca-abe43c92f7db None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.915502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b72b-1efd-4aa9-8884-7419fbedb3a6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:00.920493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.921277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.921564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.921847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.931327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:00.938259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:00.939428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 289/570] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:00.940191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:00.953516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:00.954180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:00.954467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:00.954747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:00.955494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:00.955817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:00.957203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:00.968630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 282/571] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:00.969400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.033475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd077-cb94-4e69-8dc0-79e26f48f2d5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.062002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacb22-ffb3-4473-9f24-6b7efaa7be31 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.064149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.064968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.065250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.065523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.072158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.073608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.088055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:01.089384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 290/572] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.089971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.099766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.100564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.100855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.101135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.110882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:01.117849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:01.119023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 283/573] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.119795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.181852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1620b2-1cf4-45e9-918d-a8648b406512 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.214058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf92a-1c52-4f73-b34d-976cfba5fe9a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.214579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.215370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.215690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.215971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.226331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.227830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.244973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:01.246140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 291/574] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.246285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.246908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.247004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.247197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.247487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.248233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:01.248535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.249912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.257782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 284/575] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:01.258575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.344668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5277d1-2cdc-42ea-97d2-e8e6cc6a438c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.355437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410b829-975d-4350-8ace-cba34e363319 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.377319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.378140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.378430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.378706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] PATH_INFO: `/v3/users/glance` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.385591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.387051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.387976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.389191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.389471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.389930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.390702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:01.391010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.392901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.401060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 12:45:01.402408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 292/576] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.403088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.409139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 285/577] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:01.409139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.499731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57049ff-0620-4033-8b9e-c53214037aeb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.505514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4c52-6676-42fb-9497-0a9d092e9593 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.531873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.532528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.532814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.533087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.533826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:01.534131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.535515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.538233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.538879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.539158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.539430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.540175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:01.540477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.541827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.543282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 293/578] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:01.544002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.556579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 286/579] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:01.557394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.642167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebd4f6-a1bc-4baa-9e63-e5600d08241b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.651286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d0233-a0a5-4df3-a933-b9e84d07bd78 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.673346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.674135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.674415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.674693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.682516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.683176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.683460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.683767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.684589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:01.684828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.684917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.686819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.686915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.703616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:01.704598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 287/580] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:01.709364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 294/581] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.709505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.709589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.800010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4df295-6e34-4fc3-b67c-6564cf4d07d6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.803369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c5c5e-5851-48ae-8e1b-e4ac54040bd0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.832486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.833277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.833567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.833892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.836744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.837620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.837900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.838172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:01.844613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.846086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.852586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=55ae9eb24d0a4617bb52c9680bc7a1d4, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:01.854091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:01.861975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:01.863154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 295/582] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:01.863952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.953715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 288/583] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:01 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:01.954450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:01.957658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c484c86-6459-41ea-9134-961a39e0fecf None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:01.994978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:01.995819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:01.996105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:01.996381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.004123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.005679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.020490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:02.026610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 296/584] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:02.026610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.070602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428db4b4-d91f-412c-99b2-c86d8df72d40 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.116466 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.117149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.117429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.117713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.118480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.118791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.120247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.130039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e33b76-4da4-4261-a60a-39cb8c228d8c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.139580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 289/585] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.139580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.169406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.170251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.170545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.170822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.180895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.182336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.199417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:02.200876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 297/586] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:02.202026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.246274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475ebb-ac57-4906-9fc4-6ae7bff32c34 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.283839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.284508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.284802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.285081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.285836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.286146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.287573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.303264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 290/587] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.303264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.307643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2598b-7532-4889-b87c-b27e40b92539 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.341648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.342231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.342519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.342798 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.343613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.343959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.345366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.362202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 298/588] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.363060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.397378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece2ee2-563c-49e1-9d21-1ceaa9d0f86a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.431132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.432002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.432289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.432592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.440113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.442281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.456828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 12:45:02.462667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 291/589] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:02.462667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.462888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81341f5e-4f01-48c0-b659-0bc2e6342933 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.494190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.494846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.495138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.495421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.496173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.496485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.498423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.509395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 299/590] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.510396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.562269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf50ae-36c4-47b2-9882-3637c5591209 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.594803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.595560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.595856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.596137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.603051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.604619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.608355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd15d-2223-403b-91ad-ac9077dcdcf2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.618661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 12:45:02.620182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 292/591] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:02.620963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.641596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.642530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.643029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.643503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.644578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=acf32cc208ae41bb83c0248bbcfe74a6) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.645100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.646781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.652803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 300/592] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/role_assignments?user.id=acf32cc208ae41bb83c0248bbcfe74a6&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.653781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.736090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d38b8-9ed9-40ec-b40e-2a87d39cef29 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.767519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59557853-c776-41ca-abed-c9cb79743245 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.773434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.774243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.774599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.774949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.775902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.776752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.777829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.801668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 293/593] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.801668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.812003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.813558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.814032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.814518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.823275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.825195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.840219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:02.842291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 301/594] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:02.843222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.911483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d8151-54a6-4230-97c8-24fd8a492390 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.944892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf5ff1-ebf8-411a-94cd-c638697fd272 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:02.949417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.950101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.950427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.950712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.951618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:02.951939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.953406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:02.972317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 294/595] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:02.973171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:02.983596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:02.984679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:02.985177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:02.985648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:02.996210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:02.998006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.015650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:03.017492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 302/596] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:03.018481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.086177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574ace-8f7a-42f3-bd96-b25b3a718a09 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.119672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da2c1d-baef-4462-a235-a76f5dc70dad None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.123302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.123553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.123831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.124174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.124960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:03.125324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.126792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.143911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 295/597] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:03.143911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.160744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.161859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.162374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.162851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.173584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.175260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.192401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:03.194255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 303/598] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:03.195573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.243341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56096897-dff5-4a73-af21-0ece1938ab37 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.276917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.277577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.277915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.278203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.279012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:03.279326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.280853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.295115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb27d-2e76-4cba-97b1-a9ca9aa2b90d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.298184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 296/599] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:03.298504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.329447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.330673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.331179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.331692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/b8d34ef4b64a42a897fa75e8b14c60f3/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.347347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=b8d34ef4b64a42a897fa75e8b14c60f3, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.349131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.396988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bba6cb-2f84-4e65-b332-3189c78f51f2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.429898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.430498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.430804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.431066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.431867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:03.433544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.433544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.449921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 297/600] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:03.449921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.462594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 304/601] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:03 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/b8d34ef4b64a42a897fa75e8b14c60f3/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:03.463829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.585977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbb030-2fdf-47d8-b46f-9a4ea9ba6c5f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.626443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.627780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.628269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.629196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.637884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.640478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.657207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:03.659217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 305/602] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:03.663311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecd0e2-fe3f-4753-a09a-68f92f97ad05 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.664985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.744395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.745124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.745722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.746018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.756598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.758567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.779461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:03.781029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 298/603] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:03.788349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.812362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4004905-d73c-4b91-bb6d-a2d70e394904 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:03.851893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:03.852930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:03.853415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:03.853924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:03.855023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:03.855564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:03.857905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:03.871498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 306/604] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:03.880478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:03.929706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a04f0-1637-4323-a4bb-3cf9f0481aa0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:04.009249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:04.009848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.010131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.010409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.011197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:04.011523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:04.012991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:04.026109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 299/605] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:04.033644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:04.046467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1505-7056-413c-9083-13fb7cffdea2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:04.081113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:04.082037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.082327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.082608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/6793eba624e644a9ba49910428cdb515/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.097953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=6793eba624e644a9ba49910428cdb515, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:04.099409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f5762-d6be-4711-918d-0e2aa806fb95 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:04.158769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921334-32ca-49a5-bc45-f04d0778cb69 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:04.192658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:04.194569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.194569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.194569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/ac94b28422044aed9681b0c31b9ab97e/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.209985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=ac94b28422044aed9681b0c31b9ab97e, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:04.211484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2f930-d57e-4eb8-b8b9-340a014b89c7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:04.246999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 307/606] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:03 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/6793eba624e644a9ba49910428cdb515/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:04.308927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 300/607] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:04 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/ac94b28422044aed9681b0c31b9ab97e/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:04.405200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75182f3-8b02-4146-a8bb-2d280d09e522 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.405513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75182f3-8b02-4146-a8bb-2d280d09e522 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.405813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75182f3-8b02-4146-a8bb-2d280d09e522 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.408161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 308/608] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:04.413918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.414215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.414500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.437319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:04.438550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:04.515653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 301/609] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:04.539456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75182f3-8b02-4146-a8bb-2d280d09e522 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:04.662488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75182f3-8b02-4146-a8bb-2d280d09e522 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:04.707553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:04.708428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.708722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.709003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.721003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:04.728282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:04.729882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 309/610] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:04.736355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:04.845693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507f234-a8aa-4cd9-9b43-def806886f36 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:04.880546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:04.881246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:04.881518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:04.881799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:04.882551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:04.882862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:04.884281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:04.899017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 302/611] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:04.904869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.036539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351b4b8-92ae-411f-a9e1-d66b2f698fdc None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.071525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.072319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.072603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.072879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.092067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:05.093546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:05.113912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1e849b1e-6ebd-4c29-b01e-2b391bfadaf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:05.115405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 310/612] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:05.121117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.173458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9932-d169-4b57-87a3-605e3d6bbe04 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.173824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9932-d169-4b57-87a3-605e3d6bbe04 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.174023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9932-d169-4b57-87a3-605e3d6bbe04 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.176139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 311/613] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:05.181958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.182280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.182528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.201585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:05.203110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:05.290356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e78e59-e153-4bb3-8d97-2af8574a7ee7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.307809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 312/614] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:45:05.332936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.350251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.350914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.351195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.351484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.352210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:05.352515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:05.353901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:05.377679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 303/615] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:05.384354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.435985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27743f97-3139-4a60-acba-01cad7c9c840 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.471036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.471829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.472116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.472395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.482633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:05.489442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:05.499494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 313/616] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:05.500614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.542067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c72e-fdb3-4e66-9dec-55c48af0a649 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.576571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.577437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.577887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.578186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.587234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:05.587234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:05.603889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:05.605108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 304/617] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:05.615057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.680486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef40f7a-2743-4436-8247-8428e87e2891 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.722494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.723089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.723378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.723688 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.724442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:05.724754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:05.726550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:05.735924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 314/618] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:05.744492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.760866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e749d-1ebb-4530-9d24-2cc3c64c21c0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.795836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.796510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.796799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.797078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:05.797912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:05.798272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:05.799805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:05.819231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 305/619] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:05.825000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:05.925863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fea8-e6cc-4267-a032-17691af43a08 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:05.961176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:05.961826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:05.962111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:05.962386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.002125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bdf74-ba98-4023-ad8c-41d3422f2c7d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.041823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.043829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.092283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.093106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.093398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.093679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.116568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.118194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.151525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:06.151525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 315/620] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:06.152327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.166328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 306/621] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:45:06.172784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.267797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b50a7-7c60-4eff-9cbe-deab00057b51 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.312304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.313011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.313308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.313588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.314339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:06.314628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.316046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.329415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 316/622] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:06.334458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.342511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a243a-73a3-4795-8f4d-dbba40cd32d6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.388197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.389040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.389332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.389609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.404173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.405654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.426464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:06.428235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 307/623] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:06.433499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.443021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e667c-362a-4584-bbb4-eb04122fcbd1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.516215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.517216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.517508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.517786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.525978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.527579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.541311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ce403626-4dd2-43a2-9f80-2c82de85de17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:06.542327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63155837-15ae-4db4-a647-7b3d95224031 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.547644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 317/624] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:06.549058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca917a-e2ff-4f5a-bcfc-14afea585f41 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.549351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca917a-e2ff-4f5a-bcfc-14afea585f41 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.549636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca917a-e2ff-4f5a-bcfc-14afea585f41 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.555581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 318/625] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:06.556375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca917a-e2ff-4f5a-bcfc-14afea585f41 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.582341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.583138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.583433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.583743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.584962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:06.585280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.587114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01d242-140f-4d60-aad1-84aef3f31ef4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.602438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 308/626] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:06.608043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.608358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.608641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.630310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:06.632335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:06.664214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca917a-e2ff-4f5a-bcfc-14afea585f41 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.698139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.698953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.699354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.699730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.700649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:06.701040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.702581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.720753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 309/627] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:06.721544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.724973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 319/628] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:06.730895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.838115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908680-6b54-421c-b253-e0b3828f5ba6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.872276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a898-bf62-4282-8b12-525b3c43d64c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:06.878581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.879834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.880322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.880789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.889316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.891132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.905912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:06.907916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 310/629] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:06.908862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:06.913947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:06.914948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:06.915589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:06.916017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:06.928679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:06.930584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:06.949101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:06.951350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 320/630] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:06.952391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.017660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67536-84cb-4530-924b-9cb2976e8adf None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.052048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.052868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.053138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.053423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.055560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549203-b2b7-4715-8c25-4ac377f79a9e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.064422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:07.071800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:07.077826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 311/631] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:07.077826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.097283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.097979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.098235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.098422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.099203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.099538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.100997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.113378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 321/632] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.114855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.174926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd826be-83db-4e49-9210-2e55f5fda002 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.209844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf85f-3e6e-4537-baec-c617300cc334 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.211247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.212570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.212570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.212570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.213232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.213542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.214941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134bd1a-49b4-423e-8777-c087627ab052 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 312/633] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c9d3-a82d-4fc5-8565-eac53a1688d9 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c9d3-a82d-4fc5-8565-eac53a1688d9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218c9d3-a82d-4fc5-8565-eac53a1688d9 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 313/634] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:07.231147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218c9d3-a82d-4fc5-8565-eac53a1688d9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.252285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.252949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.253234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.253512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.254250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.254557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.255970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.263591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 322/635] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.264542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.326884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218c9d3-a82d-4fc5-8565-eac53a1688d9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.358519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd27404-6d0a-49c8-9230-f599dbf6058f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.359273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.359953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.360241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.360525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.361346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.361662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.363103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311935d-dc55-4be1-a97c-c531e87ae8f0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.368688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 314/636] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.369840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.370132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.370415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.388541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:07.389775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:07.391992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.392807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.393094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.393394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.402329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.404390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.418719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-9ce18983-7383-4d89-a0ae-da493f7f892d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:07.420625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 323/637] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:07.421888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aad7d-d3bc-4dfa-a1c9-abd674a5de71 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.422178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aad7d-d3bc-4dfa-a1c9-abd674a5de71 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.422459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50aad7d-d3bc-4dfa-a1c9-abd674a5de71 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.427911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 324/638] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:07.427911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50aad7d-d3bc-4dfa-a1c9-abd674a5de71 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.471992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 315/639] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:07.472954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.542401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50aad7d-d3bc-4dfa-a1c9-abd674a5de71 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.585005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.585755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.586046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.586141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51450e4-b090-492e-9a2d-01e1736cbdda None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.586328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.598029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.599717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.618629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4b854394-9374-4d65-a671-2ce5938de118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:07.619970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 325/640] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:07.621025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.621321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.621610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.626429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.627093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.627378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.627693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.628951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.628951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.630234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.638981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:07.640215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:07.642511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 316/641] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.643175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.713135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 326/642] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:07.713981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.755348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be3a6-58f6-4e67-9bf8-f374cd84b342 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.789254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.790053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.790333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.790610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.800454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:07.807217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:07.808428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 317/643] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:07.809160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.815781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf17c3-1afb-42b0-bcb0-f73d86c7e4ed None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.849877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.850914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.851275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.851650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.852381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:07.852690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.854085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.870015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 327/644] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:07.870015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:07.908391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c7c2-022f-46b8-812d-f7c5073e8867 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.947044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.948342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.948783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.949069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/acf32cc208ae41bb83c0248bbcfe74a6/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:07.964859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2a04-e3d7-43ae-a080-ab96b7c5ffde None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:07.965288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=acf32cc208ae41bb83c0248bbcfe74a6, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:07.967538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:07.996211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:07.996996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:07.997277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:07.997567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.007231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:08.014950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:08.016171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 328/645] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:08.017900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.033903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 318/646] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:07 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/acf32cc208ae41bb83c0248bbcfe74a6/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:08.035055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.127735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977712ba-22cc-4b1e-acff-6e6f8cbd8496 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.146307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c587-9156-47aa-90ef-ae54cffac2e2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.164056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.164765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.165054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.165336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.166113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:08.166427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.167869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.181595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 329/647] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:08.182658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.186873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.188405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.188928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.189405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] PATH_INFO: `/v3/users/glance` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.198084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.199991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.215643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 12:45:08.217762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 319/648] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:08.218807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.298816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf3e7-62b3-4509-bdfe-2f782925411c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.324013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6946dc-33a0-4913-9de0-db191224858a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.333058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.333726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.334015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.334400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.335154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:08.335461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.336858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.345328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 330/649] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:08.346136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.358823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.359704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.359984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.360256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.370565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.372159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.390093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:08.391576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:08.392411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.443875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225b66-a73c-4dda-8979-64fdfe4e46cb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.477467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.478135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.478418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.478696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.479571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:08.479885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.481322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.490917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2fe1-82e1-4df5-8614-119d2f1062bc None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.499528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 331/651] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:08.500370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.526800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.527951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.528491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.528774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.543888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.545390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.562683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:08.564316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 321/652] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:08.565105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.611398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16969e1-96d3-47ca-9130-e28b5492fd7b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.646187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.646967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.647209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.647515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.648244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:08.649118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.649974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.662188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 332/653] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:08.663025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.684347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd6de-a4d5-4152-9bb3-3085d3c1b9b7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.724757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.725889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.726184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.726478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.775062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f18e-7313-4e32-aad9-4d4291e80d15 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:08.797475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.798950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.817132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:08.817800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:08.818088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:08.818774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:08.819539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:08.820406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:08.822336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:08.837993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 333/654] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:08.839211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.901585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 322/655] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:45:08.902366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:08.967232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f8db4-5442-440f-b356-f97e855dc620 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.005754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5728-dd87-4ffc-a5d4-20caad262b11 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.006525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.007328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.007663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.007927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.015733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.017186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.030939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 12:45:09.032446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 334/656] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:09.033329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.042993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.043969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.044257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.044620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.051893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.053357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.067885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 12:45:09.073619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 323/657] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:09.073619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.158594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5449-76b6-4650-9fa7-77b90ab3c3eb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.193067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.193983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.194341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.194692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.196942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc5277-b929-4c7c-9441-45dc3c059576 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.206163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.207755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.224813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:09.230471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 335/658] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:09.230471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.246194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.247417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.248458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.249059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.250419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:09.250883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.252519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.280070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 324/659] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:09.280821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.352120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf87a-c569-4a23-ba8b-f6c0eb62c588 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.385577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34fbc-8abe-4129-9d1f-6ceeb75d12e4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.390801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.391496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.391781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.392057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.392889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:09.393200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.394645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.421310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 336/660] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:09.421310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.431730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.433180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.433725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.434185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.435853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:09.436352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.438792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.459733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 325/661] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:09.461398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.542856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb29e-3abe-4798-99ed-0955f637e862 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.582655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178431bf-9a68-49ba-bf8f-ad5318e721a9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.583278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.584161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.584661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.585128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.624429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.625120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.625405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.625679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.652958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.655289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.703439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.705250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.782257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 337/662] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:45:09.782257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.808458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 326/663] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:45:09.809308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.882368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf190f1-f6a4-44e2-bcc4-b48ba6c9b7a1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.908362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8871922-30bb-48f0-a05b-78567f660268 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:09.915434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.916296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.916581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.916852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.923950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.925387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.938178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-bf0b9ff8-d903-47a1-8945-831de5d04789 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 338/664] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6860-3e3a-4ecc-9bce-7d1a34a82eeb None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6860-3e3a-4ecc-9bce-7d1a34a82eeb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6860-3e3a-4ecc-9bce-7d1a34a82eeb None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 339/665] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:09.947296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6860-3e3a-4ecc-9bce-7d1a34a82eeb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:09.954937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:09.955705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.955988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.956262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:09.967117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:09.968662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:09.985116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c963ca9e-e19f-453d-b7e2-6c487573f427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:09.986308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 327/666] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:09.991946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:09.992354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:09.992640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.014144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:10.015716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:10.052152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6860-3e3a-4ecc-9bce-7d1a34a82eeb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.087351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.088555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.089152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.089649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.091153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 328/667] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:10.092638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.110878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.113097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.131202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:10.132420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 340/668] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:10.133190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.199364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceaa9c-6535-4294-91d3-384c309f8154 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.230130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2684e9-7fb3-4024-a693-4898d0c23f52 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.233251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.233901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.234184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.234459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.235236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.235575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.237034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.253478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 329/669] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.253478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.262287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.262934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.263858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.264147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.264875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.265184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.266559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.278053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 341/670] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.279393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.355223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ffbd-7744-4aff-99e1-4b3f8bdcebee None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.385088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e5701-6657-47ed-84bf-3c582add8d03 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.387315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.388141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.389038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.389312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.399292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:10.406124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:10.407312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 330/671] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:10.408100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.417704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.418353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.418636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.418912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.419686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.419992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.421352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.431869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 342/672] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.432635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.504361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d4c4a-08cd-40c1-8757-a27c213dc163 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.526748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b29c2d-2589-4f82-b4ed-dbb8b28bb9da None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.535537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.536178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.536462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.536738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.537554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=b8d34ef4b64a42a897fa75e8b14c60f3) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.537861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.539306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620550ed-9a7e-4ea8-b45d-e092a9bfe98f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.545202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 331/673] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/role_assignments?user.id=b8d34ef4b64a42a897fa75e8b14c60f3&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.546394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead479-4089-4590-8249-c1ceb505cf8e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.546698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead479-4089-4590-8249-c1ceb505cf8e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.546961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead479-4089-4590-8249-c1ceb505cf8e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.548895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 332/674] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:10.549634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ead479-4089-4590-8249-c1ceb505cf8e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.562231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.563398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.563899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.564350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.572355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.574161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.589970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:10.591912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 343/675] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:10.592882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.665839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ead479-4089-4590-8249-c1ceb505cf8e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.696173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4451a-1b7a-4265-ac34-2e775c82423d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.701563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.702241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.702526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.702804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.703590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.703902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.705320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e01ba-2648-4f79-ae61-5eb1101eb3d1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.714660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 333/676] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.716324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.716823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.717494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.735976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:10.737061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:10.743324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.744365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.744657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.744940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.752200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.753664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.767246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:10.768409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 344/677] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:10.769176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.805720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 334/678] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:10.806574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.878882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd734af-e84a-4f51-8a06-8cd64879b2f9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.907115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e68f-32c1-4271-8939-f151cd18a85c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:10.910538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.911496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.911991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.912465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.913462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:10.914003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.915546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.929038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 345/679] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:10.929792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:10.945766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:10.946569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:10.946850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:10.947122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:10.958101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:10.959603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:10.975865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:10.981564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 335/680] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:10.981564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.029690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13745-a9ca-4543-8fa2-d576e8cf2fd3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.062061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.062724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.063007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.063282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.064090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.064402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.065898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.077350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 346/681] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:11.078360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.080939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa05f10-dea2-4c84-b4b2-c286b1422d84 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.113552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.114344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.114627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.114901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.124991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:11.132091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:11.133525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 336/682] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:11.134204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.175305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16f45f-81c0-446f-9a8e-3ffe1a6c33a9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.206519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.207156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.207437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.207764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.208585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=6793eba624e644a9ba49910428cdb515) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.208893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.210314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.223890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 347/683] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/role_assignments?user.id=6793eba624e644a9ba49910428cdb515&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:11.224959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.234906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877fe5-733c-4014-b417-791334b93ed1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.279662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.280518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.280945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.281307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.282111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.282543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.284185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.302726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 337/684] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:11.303871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.355051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb8f6d-4c88-48a5-b8d1-ddaed076c01a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.403113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.404601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.405036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.405469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.406307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=ac94b28422044aed9681b0c31b9ab97e) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.406626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.408121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.415160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6e06-78f9-4939-a574-838811c1605c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.415409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 348/685] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/role_assignments?user.id=ac94b28422044aed9681b0c31b9ab97e&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:11.416262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.455747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.456445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.456734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.457010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.457785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.458099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.459561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.469821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 338/686] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:11.475375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.527054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890acc55-3a96-43cc-8e15-48ff2fec16bd None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.563280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.564079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.564372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.564653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.573387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.574871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.584757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d40db-cd1b-491e-8887-7adbc4805f65 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.589726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:11.591064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 349/687] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:11.597408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.647731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.648584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.648875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.649156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.665219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.666738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.688431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:11.689988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 339/688] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:11.695549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.718444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7aa38-9f0b-4c0c-b147-f8754c738493 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.761579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.762769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.763786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.764368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.765977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.766438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.768919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.794051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 350/689] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:11.800017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.821052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cc8e5-382f-4cdf-92a3-1f0990d39883 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.866719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.868312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.868741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.869167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:11.870680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:11.871143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:11.873370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:11.890244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 340/690] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:11.896516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:11.914050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb254bf-89ca-4700-aaf9-1cfaa9259784 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:11.959414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:11.960246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:11.960622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:11.961043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.024845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fe33-fd7a-4888-a34d-48f63376e098 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.064921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:12.065997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:12.066426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:12.066868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.074665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.076884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.083659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.085136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.092062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:12.093767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 341/691] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:12.104400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.182652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 351/692] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 12:45:12.196552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.254971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602294c3-947e-4949-9c14-c9b08f8fd05c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.317768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:12.318929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:12.319225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:12.319531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.320774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:12.321238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.322864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.359977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 342/693] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:12.365566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.386227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0291e-6b20-432a-a82c-885dd7f0c074 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.451851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:12.452649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:12.452936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:12.453215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.464534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.465997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.487342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:12.490599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 352/694] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:12.495136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.527797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f16c48-e1b4-407c-bd17-b4a58c4534da None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.588064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:12.588718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:12.589004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:12.589288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.673407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2176e7-ab61-4f26-98e8-1291dc5b395c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.707355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.708909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.738956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:12.739656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:12.739943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:12.740221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:12.740960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:12.741269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:12.742684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:12.765225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 353/695] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:12.769152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.870054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 343/696] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 12:45:12.875410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:12.940486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f44ef4-05ce-46e3-b754-650a6085bb00 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:12.974331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ac9d-63d7-472b-b011-3956f227bbe7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.006801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.008065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.008608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.009121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.010046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.010960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.011347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.011781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.022651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.025306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.025660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.027493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.047374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:13.049122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 344/697] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:13.050610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:13.052329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 354/698] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:13.056913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.057966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.167505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af6ea-87a6-4981-853f-0bd465ea7eec None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.198622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.199210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.199506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.199775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fefb-e672-4dff-8603-66113d760d11 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.199901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.200506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.201338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.202927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d394b-b43a-4f33-bc98-b34f214cbabb None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.218116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 345/699] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:13.220495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374af037-0c3e-4830-ad29-c56d7c905218 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.220989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374af037-0c3e-4830-ad29-c56d7c905218 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.221465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374af037-0c3e-4830-ad29-c56d7c905218 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.226306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 346/700] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:13.228190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374af037-0c3e-4830-ad29-c56d7c905218 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.243212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.243922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.244217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.244493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.245287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.245601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.247047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7476-083f-4438-b931-3d3bfca9063c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.259401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 355/701] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:13.260698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.261000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.261296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.279850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:13.281094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:13.351728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 356/702] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:13.352801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.361030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374af037-0c3e-4830-ad29-c56d7c905218 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.415493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.416299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.416587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.416869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.425785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.427433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.445812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:13.451575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 347/703] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:13.451575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.476975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf30fc-a1c5-41b6-8323-7c4f726ec428 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.512785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.514377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.514912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.515388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.516466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.517085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.518748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.524898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 357/704] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:13.525976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.555192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211e94-3e9e-4afd-ab4c-e6772deff53a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.592427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.593229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.593606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.593808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.605071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.606562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.624932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:13.626244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 348/705] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:13.632069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.634826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca44d4-91bf-49e2-a67e-b7c12ca1527f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.671266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.672322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.672897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.673405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.674403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.674914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.676756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.690563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 358/706] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:13.697245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.739013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7525a7-90bf-450c-acca-c929b19f9925 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.776056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.776899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.777200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.777483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.778238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.778553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.780138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.793153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 349/707] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:13.799438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:13.809010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d2b5-12cf-4e01-bdaa-81737cba989a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.845888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.846932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.847428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.847998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.849085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=acf32cc208ae41bb83c0248bbcfe74a6) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:13.849668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.851451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb07a4-018b-40c9-9180-e4d61f6cc650 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:13.859298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 359/708] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:13 2022] GET /identity/v3/role_assignments?user.id=acf32cc208ae41bb83c0248bbcfe74a6&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:13.919013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad798-eb0f-4008-9caf-dfd88939f520 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:13.958166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:13.958911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:13.959196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:13.959497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:13.960242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:13.961737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c8ba1-2385-4667-a8cf-55a24d7de148 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:14.058074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 350/709] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:45:13 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:14.229692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663872c-17ad-4f87-bafb-87b9850624a5 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.230392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663872c-17ad-4f87-bafb-87b9850624a5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.231093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663872c-17ad-4f87-bafb-87b9850624a5 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.233630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 360/710] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:14.239657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.240268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.240763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.261387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:14.262908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:14.266993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a725-661d-4724-b79f-f22965e09ca3 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.267282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a725-661d-4724-b79f-f22965e09ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.267593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a725-661d-4724-b79f-f22965e09ca3 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.269603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 361/711] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:14.275341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.275719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.276803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.297751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:14.298986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:14.339139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 351/712] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:14.363776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.372051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 362/713] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:14.398269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.471176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4c24-32b5-4ce8-92cd-ade46741fee5 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:14.499939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada793b2-7db0-403b-a300-89378c72aeb1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:14.506350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:14.507169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.507531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.507817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.508536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:14.509929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:14.524343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 12:45:14.525883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 352/714] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:14.531452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.537480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:14.538544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.539031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.539522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] PATH_INFO: `/v3/services/network` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.540400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:14.541974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:14.555444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 12:45:14.557258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 363/715] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:14.563258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.685580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5d85d-72b5-4136-96f2-1986f33c19cf None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:14.735234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:14.735940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.736227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.736508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.737221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:14.737533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:14.738929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:14.748099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e657-bba0-4647-848c-2e7a9bb7c200 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:14.751024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 353/716] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:14.756442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.814934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:14.817370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:14.817370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:14.817370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:14.817370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] RBAC: Adding query filter params (name=network) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:14.817370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:14.818618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:14.830237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 364/717] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:14.835298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:14.933016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b63bcf-c250-4f3a-8055-d4ea8b827763 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:14.993530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883df782-1ee6-41f8-92d0-6fb50dcbf614 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:15.025053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:15.025957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:15.026409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:15.026530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:15.026940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:15.027047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:15.027344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:15.027657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:15.028292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:15.028400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] RBAC: Adding query filter params (type=network) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:15.029185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:15.029511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:15.030818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265fa5a-62ff-4e4e-8ef0-d004cee9906e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:15.031193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36e5f-dbac-434a-908f-395898332293 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:15.036903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 365/718] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:15.049823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 354/719] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:16.458685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa2ea-a19e-40fd-83c0-20c1a7f96fa2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.459242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa2ea-a19e-40fd-83c0-20c1a7f96fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.459564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaa2ea-a19e-40fd-83c0-20c1a7f96fa2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.461711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 366/720] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:16.467062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.467512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.467814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.488468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:16.489683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:16.560393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 355/721] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:45:16.600975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaa2ea-a19e-40fd-83c0-20c1a7f96fa2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:16.711432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaa2ea-a19e-40fd-83c0-20c1a7f96fa2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:16.745499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:16.746291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.746576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.746851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.757486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:16.764420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1bda411f-21f3-47a1-b363-5447b741a1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:16.765918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 367/722] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:16.771649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:16.922463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa3ce5-3742-44b1-b1f1-ec4439cfa2d4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:16.978609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3de00-9989-47c1-b19e-9cbbfd437eed None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.978609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3de00-9989-47c1-b19e-9cbbfd437eed None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.978609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3de00-9989-47c1-b19e-9cbbfd437eed None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.978609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 368/723] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:16.984942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:16.985677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c67a6-8818-4a52-a7e9-1da35049e25b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.985979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c67a6-8818-4a52-a7e9-1da35049e25b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.986256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c67a6-8818-4a52-a7e9-1da35049e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.986534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:16.987090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:16.987612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:16.988567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:16.989072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:16.990679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.000943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 356/724] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:17.006768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.025963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3b4c67a6-8818-4a52-a7e9-1da35049e25b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:17.027611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3b4c67a6-8818-4a52-a7e9-1da35049e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:17.145960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049595-2044-4e81-b39f-b06fcd5a4d91 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.159004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 369/725] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:45:17.160563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3432-9f1d-4867-8afd-dde801d74bd2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.163523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3432-9f1d-4867-8afd-dde801d74bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.164041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3432-9f1d-4867-8afd-dde801d74bd2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.166235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 370/726] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:17.185098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.185694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.186162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.197033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.197885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.198175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.198503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.205092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:17.206930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:17.211167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.212715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.233850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:17.239929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 357/727] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.239929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.289168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 371/728] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 12:45:17.290837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.375364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf7d13-6cef-44b9-bc3b-683b9bb3e5b6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.406804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78a33b-2a80-49c4-adc8-5176df45e6c3 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.408792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.410244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.410244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.410462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.427978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:17.434861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:17.441789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 358/729] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.441789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.462156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.464268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.464553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.464827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.465591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:17.465901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.468049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.485920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 372/730] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:17.486451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.563813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658c3d-923c-4f40-a06f-0c1841f9d79d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.597775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617293a0-40ce-4c23-808e-6a94cb9f092c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.606805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.607891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.608850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.609353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.622129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:17.631628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:17.637874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.637874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.637874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.637874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.638740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:17.638740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.638740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.639277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 359/731] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.640682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.651504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 373/732] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:17.651504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.745992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebab29d-d143-438c-816d-7f1c37ac03c0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.751723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b93ac-8766-4fcc-b7c9-aba277776d7b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.779866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.780650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.780930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.781200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.787527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.788474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.788957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.789432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.789534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.790475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:17.790904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.791186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.792820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.805676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:17.806303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 374/734] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:17.807375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.810091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 360/734] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.810919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.906789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313b69c-29a4-48f8-8333-852f2f82559d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.907603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080399-f2a3-4f98-a5df-37fd660cf77d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:17.938101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.938879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.939110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:17.939237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.939426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.939924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.940216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.940495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.951647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.951769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:17.953129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.953225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:17.968915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:17.969051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-dc522d2a-9167-4b3d-a7ef-81eaf7a76969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:17.974978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 361/735] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.975112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 375/736] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:17.975188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0110585-8400-483e-8001-5844926b9c7b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0110585-8400-483e-8001-5844926b9c7b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0110585-8400-483e-8001-5844926b9c7b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 376/737] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d2a3-647a-4bfa-a133-6d58b648ac4a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:17.975257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d2a3-647a-4bfa-a133-6d58b648ac4a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:17.975670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1d2a3-647a-4bfa-a133-6d58b648ac4a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:17.976831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 377/738] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:17.978274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1d2a3-647a-4bfa-a133-6d58b648ac4a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.073084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f58ea6-5113-43ee-943d-e48eb357b1a2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.073602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1d2a3-647a-4bfa-a133-6d58b648ac4a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.104638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.105300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.105408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.105583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.105857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.106052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.106339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.106616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.106726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:18.106973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.107338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:18.107677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.108437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56c6ca-ba0e-4936-9937-adb6b58d4190 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.109034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.120475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 378/739] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:18.121105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.133702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 362/740] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:18.133702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75968ee-6ce9-489a-93c1-bc2ddfdbcc5b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.133702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75968ee-6ce9-489a-93c1-bc2ddfdbcc5b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.133702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75968ee-6ce9-489a-93c1-bc2ddfdbcc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.147588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d75968ee-6ce9-489a-93c1-bc2ddfdbcc5b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:18.148768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d75968ee-6ce9-489a-93c1-bc2ddfdbcc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:18.210598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 363/741] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:18.211853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.212149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.212429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.214923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec19-8cfc-4862-829f-00423724fe22 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.231264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:18.233170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:18.246947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.248176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.248463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.248739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.249567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:18.249882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.251251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.262507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 379/742] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:18.263267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.298805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 364/743] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 12:45:18.299661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.367106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f145a01-ae97-4bee-a9ad-6de989ac032a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.391818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8feb-5437-45c0-a468-5f91e9b63995 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.398466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.399262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.399573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.399850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.406468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.407946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.421989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:18.423141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 380/744] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:18.423897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.424020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.424747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.425035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.425311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.435695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.437155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.453661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:18.454819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 365/745] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:18.455602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.519613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1688c-c3c9-4a0c-92e9-bd6157603252 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.548399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a085b-0e79-45cd-8c9a-9441e8cca599 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.550699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.551343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.551661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.551937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.552649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.554019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.580864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.581644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.581945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.582206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.589042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.590484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.604443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:18.605594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 366/746] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:18.606324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.640296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 381/747] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:18 2022] POST /identity/v3/services => generated 240 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:18.641125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.711782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430b50d-00b6-4b62-9ea0-81a513ddd57f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.758841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fe472-eedf-4892-86d7-433976fb5913 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.764555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.765580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.766092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.766598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.768023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.769524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.793235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.793907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.794191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.794466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.795308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:18.795644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.797145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:18.816242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 382/748] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:18.817580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.835028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 367/749] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:18 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:18.836035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:18.934420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6286a00-9fe1-4b52-98c9-917ebb7d81c9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.979551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b98809-112f-4a9d-92cd-9531a11cdaa2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:18.981072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:18.982465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:18.982743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:18.983017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:18.983829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:18.984335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:18.985860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.007114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 383/750] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:19.011678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.034167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.034849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.035139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.035415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.036304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:19.036619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.038159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.058061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 368/751] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:19.063780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.129790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd507ba-5e45-460f-b519-c81888b8f040 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.162312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.162956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.163238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.163543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.167109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532ced2-f7b1-4d22-9ec4-37dbe808a86c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.201779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.202505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.202788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.203066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.210001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.211556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.224905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:19.229454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.230850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 369/752] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:19.231234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.232294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.328600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 384/753] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:19.329514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.341960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a7573-afcf-4b65-b401-01d8e02c0019 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.385630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.387044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.387803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.388315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.442683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2b5d8-33fa-4005-887f-409d4c294499 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.462703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.464200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.483946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.484926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.485410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.485883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.486892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:19.487408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.489068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.501174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 385/754] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:19.502250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.571653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 370/755] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:19.572571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.604609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7bcaf-d8e2-49a1-a649-a5900d833718 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.638745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.639907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.640423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.640896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.651655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.653403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.671082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:19.672111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbd6e-3a53-457a-a2d5-18cb900894ae None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.673471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 386/756] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:19.674440 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.707544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.708453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.708789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.709071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.711501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=55ae9eb24d0a4617bb52c9680bc7a1d4, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.712575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.778261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794690-f824-4ac3-9d88-9f2aaa927259 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.782532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 371/757] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:19 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:19.784451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.845184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.846076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.846370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.846648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.869052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.870750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.903393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:19.905544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 387/758] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:19.906865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95caeca7-8017-4377-9e3b-e0801bd5d248 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:19.910968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:19.948340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:19.950097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:19.951135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:19.951643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:19.952585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:19.953095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:19.955313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:19.969811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 372/759] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:19.975081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.093216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c707-a299-47ae-b4e8-3d66cd1efb87 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.135109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85406f-d782-4ac5-933c-ec88426e81e5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.160741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.162478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.162913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.163336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.173306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.174775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.176454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.177115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.177401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.177681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.178406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:20.178717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.180112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.192983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 388/760] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:20.199512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:20.199658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.199752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 373/761] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:20.204115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.311265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667498-3ac6-4633-be73-ab91a2c2ddd3 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.349195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428e52-916e-4699-a469-690cf8565562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.350226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428e52-916e-4699-a469-690cf8565562 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.350706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428e52-916e-4699-a469-690cf8565562 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.351631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03428e52-916e-4699-a469-690cf8565562 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.352617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428e52-916e-4699-a469-690cf8565562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:20.353126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428e52-916e-4699-a469-690cf8565562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.354935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03428e52-916e-4699-a469-690cf8565562 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.367810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 374/762] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:20.376439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428e52-916e-4699-a469-690cf8565562 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.446116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1838-2761-4079-a1f8-94c4f3376f65 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.480600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.481387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.482202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.482481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.489468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.490917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.504175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:20.511908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 389/763] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:20.517287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.531003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03428e52-916e-4699-a469-690cf8565562 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.565445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.566107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.566391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.566672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.567516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=83d400660fda46bb810dddd5c79ebdc5) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:20.567837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.569285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.575434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 375/764] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:20 2022] GET /identity/v3/role_assignments?user.id=83d400660fda46bb810dddd5c79ebdc5&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:20.683553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1994-3e37-48d2-a9d2-d7bdd859e6ce None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.739265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.739983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.740269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.740545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.741348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:20.741657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.743100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97454-4891-4ca4-95f9-0095769ec16a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.756915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 390/765] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:20.762546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:20.866492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da46a4-8fd1-498a-9c2b-1afd2245e167 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:20.900897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:20.901566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:20.901887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:20.902164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:20.902994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=acf32cc208ae41bb83c0248bbcfe74a6) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:20.903311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:20.905324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfef7-4a23-4168-9305-465a7f74b22e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:20.911888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 376/766] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:20 2022] GET /identity/v3/role_assignments?user.id=acf32cc208ae41bb83c0248bbcfe74a6&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:21.298919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b369bf-2a9e-428d-a26b-0bfb9615f999 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.299253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b369bf-2a9e-428d-a26b-0bfb9615f999 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.299422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b369bf-2a9e-428d-a26b-0bfb9615f999 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.301431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 391/767] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:21.306833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.307132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.307417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.336461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:21.337765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:21.383715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160dce-72ec-434b-8530-1cc34b94bbb1 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.383715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160dce-72ec-434b-8530-1cc34b94bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.383715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1160dce-72ec-434b-8530-1cc34b94bbb1 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.383715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 392/768] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:21.390393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.390687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.390975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.414619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 377/769] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:21.424347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:21.425562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:21.491599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:21.516631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 393/770] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:21.557421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:21.661085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c140a4-ad73-4058-a9df-7953b1c30a52 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:21.720945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ce2b4-c308-430a-a425-9bea0b2a36ce None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:21.730846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:21.731711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.731999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.732281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] PATH_INFO: `/v3/services/network` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.732948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:21.734339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:21.754378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 12:45:21.755625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 378/771] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:21 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:21.766307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:21.799816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:21.800680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:21.800973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:21.801250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:21.801914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:21.803297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:21.822549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 12:45:21.831503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 394/772] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Feb 28 12:45:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:21.836360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:21.949478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac036-d710-48b5-af17-b2d1cf9ffd1b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.008635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bdf44-9efe-464d-87e5-7348b881ab5e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.025041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.025714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.025997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.026278 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.027008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] RBAC: Adding query filter params (name=network) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.027309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.028774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.038380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 379/773] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:22.056458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.076535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.077141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.077432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.077717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.078524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.078834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.080255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.091950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 395/774] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:22.097550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.215497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b409a-20bf-45ba-adb7-0c7b95d92879 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.255403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.256102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.256389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.256670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.257386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] RBAC: Adding query filter params (type=network) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.257698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.259114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.271045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 380/775] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:22.293271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.311967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f733e4-8ae0-4a20-b9ae-ef9753588457 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.345930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.346573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.346862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.347192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.347933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.348245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.349628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.362057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 396/776] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:22.367779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.410003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd388c9-f3df-44ba-908f-1cdb03f6962f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.459757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.460438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.460722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.461001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.461802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] RBAC: Adding query filter params (interface=public, service_id=70aa617c9b5541e6aba77d7dfb9ffb33, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.462123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.463537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.480537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 381/777] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/endpoints?service_id=70aa617c9b5541e6aba77d7dfb9ffb33&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:22.496866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.556006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61dcfe-1d5f-45eb-b7b4-1bce05e8c61f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.602951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.603560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.603851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.606341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.607839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] RBAC: Adding query filter params (interface=public, service_id=78fa985712be414a9dd453be6789a34b, region_id=RegionOne) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:22.608160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.609551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.627770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 397/778] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/endpoints?service_id=78fa985712be414a9dd453be6789a34b&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:22.635719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:22.683150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e2200-0fc0-4bc5-b597-d6f8d35cc536 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.760609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2582f7-3770-400e-a09b-7978c5b79f6c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:22.762334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.763620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.763915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.764240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.764945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.766353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905828ad-bbfd-402b-b9eb-60c67c9314cc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.781856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 382/779] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:22.796159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:22.796834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.797118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.797395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.798093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:22.799533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931da2b-86ae-42af-be34-7352d2d44a65 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:22.805700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 398/780] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:22 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:22.836171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98761-0ba8-41c1-a67e-3fcd1203aea2 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.836473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98761-0ba8-41c1-a67e-3fcd1203aea2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.844478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd98761-0ba8-41c1-a67e-3fcd1203aea2 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.844478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 383/781] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:22.845230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:22.845526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:22.845811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:22.876900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:22.878082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:22.978361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 399/782] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:23.014640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98761-0ba8-41c1-a67e-3fcd1203aea2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.129259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd98761-0ba8-41c1-a67e-3fcd1203aea2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.163671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.164469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.164755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.165034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.177574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:23.185291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-884c70be-775c-4fb8-ac27-88a7f0dd0b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:23.186890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 384/783] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:23.192917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.234108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f4e7-c8c9-4e3f-b29f-26050f792be2 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.234424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f4e7-c8c9-4e3f-b29f-26050f792be2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.234667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f4e7-c8c9-4e3f-b29f-26050f792be2 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.237728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 385/784] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:23.241732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.242024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.242304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.266243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:23.267450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:23.341079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14dd2-1ac2-4064-983a-e5ec099d420a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.385061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.385661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.385952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.386234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.386987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:23.387298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:23.389289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:23.398762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 400/785] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:23.404434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.422319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 386/786] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:23.461856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.506341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332d2de-9bfd-44e3-88a9-a09543acc64d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.547111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.548947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.549615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.551397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.568648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:23.571614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:23.602996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:23.606127 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:23.612079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.648600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8005-4459-42ba-a0c2-cf1931c8b2bb None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.702808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.703647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.703936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.704217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.722876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:23.732643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-cccf7a39-0dc2-4bc3-bd3a-1a86a275cafb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:23.738732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 387/788] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:23.738732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494ad9-a5bf-4902-998f-ef4512711875 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.738732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494ad9-a5bf-4902-998f-ef4512711875 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.738732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4494ad9-a5bf-4902-998f-ef4512711875 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.739546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 388/789] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:23.740507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4494ad9-a5bf-4902-998f-ef4512711875 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.751973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bffae6-8db5-46f3-8e93-566c63e17a03 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.791642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.793530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.794559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.795458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.796701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:23.797218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:23.799223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464056fb-fa65-4feb-8c69-e6c2ca9f4e9e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:23.814996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 402/790] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:23.816843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.817339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.818081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.839875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:23.842201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:23.865260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4494ad9-a5bf-4902-998f-ef4512711875 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:23.899530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:23.900145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:23.900433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:23.900721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:23.901468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:23.901780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:23.903164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:23.916520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 389/791] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:23.917575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:23.943810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 403/792] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:23.944991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.033972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c18b98-9fdf-4136-b5a8-b142433c0338 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.077575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453c3c-d29f-4689-b2f6-833ee5da5aef None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.080703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.081679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.081961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.082238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.093038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.095568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.114063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.114562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:24.114905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.115196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.115492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.116611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 390/793] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:24.117640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.130709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.132384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.154203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:24.155644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 404/794] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:24.156507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.236892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc5a9-90cb-4ecb-9b22-cc365e8c2449 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.280360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.280789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce130-fbc3-4bf7-87ba-e0c9173dafd3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.281397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.281785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.282335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.296237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:24.305379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:24.307354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 391/795] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:24.312346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.318851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.319593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.320145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.320424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.321263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:24.321579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.323016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.343571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 405/796] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:24.344446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.422678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f06c8-8f10-467f-af80-5c1148a848e1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.455551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.456392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.456934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.457356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.458204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:24.458417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390042a1-161f-4f32-a017-0ae20370d1c5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.458814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.460387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.472295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 392/797] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:24.473244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.499043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.500031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.500529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.500952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.501830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:24.502329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.503861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.512369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 406/798] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:24.513346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.594047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cc337-c54c-4083-bf12-fa46929c31ac None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.627614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.628497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.628957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.629376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.632275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd478-14b2-49fc-871e-f9844a7d5000 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.672130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.673758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.674284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.675104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.686233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.688439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.701151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.702831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.706822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:24.712859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 407/799] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:24.712859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.820207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 393/800] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:24.821272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.835723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ece05-d043-447a-9a07-b128d9ac5a4c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.871218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.872037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.872497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.872783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.884839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:24.886275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:24.903233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:24.905349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 408/801] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:24.906224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:24.947885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea612-7407-4ad6-bdbe-933f1f6ca1d5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:24.996856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:24.997921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:24.998427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:24.998900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:24.999961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.000476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.002128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.016635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aa84c-dcd8-4d71-a767-4df6fb5d473a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.020991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 394/802] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.022123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.054130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.054980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.055281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.055588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.068649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.070455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.090536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:25.092801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 409/803] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.093714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.130596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c669-8d57-49e1-b03f-e88e177c4937 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.165337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.166353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.166994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.167506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.168428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.168958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.170578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.182590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 395/804] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.183725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.196792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711faf43-c215-4203-8668-47fcf3c85c7c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.232159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.233043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.233339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.233622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.244313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.245825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.262438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:25.264579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 410/805] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.265513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.286565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26d900-4b12-43f3-8c58-de7a4a0d27a7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.320661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.321686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.322186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.322656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.323635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.324142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.326491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.338988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 396/806] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.340127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.368280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8477a4-25f4-4a93-942c-46424122d8a0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.403029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.404170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.404622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.405048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.414128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.415868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.429868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:25.431196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 411/807] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.434342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.441509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86842dd0-3d68-430a-a0c4-1744488340f6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.475318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.475938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.476225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.476504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.477224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.477531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.478926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bd76-c48d-4e3c-81e3-4ed11621bb9a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.489810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 397/808] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.491025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4936-c31d-4614-ae89-ccb8fc7ef565 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.491318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4936-c31d-4614-ae89-ccb8fc7ef565 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.491632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4936-c31d-4614-ae89-ccb8fc7ef565 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.494769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 398/809] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:25.494769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4936-c31d-4614-ae89-ccb8fc7ef565 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.528363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ba910-2f0c-4a29-a03b-c98efdbab35a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.558747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.560064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.560358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.560630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.566950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.568426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.582212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-9c91d9b3-e325-46d6-8833-2e15b86d3a07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:25.583372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 412/810] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.584574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f3e57-a370-4ad7-96aa-8edd00c75739 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.584859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f3e57-a370-4ad7-96aa-8edd00c75739 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.585137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f3e57-a370-4ad7-96aa-8edd00c75739 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.586920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 413/811] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:25.587461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f3e57-a370-4ad7-96aa-8edd00c75739 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.592482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4936-c31d-4614-ae89-ccb8fc7ef565 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.624235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.624898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.625183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.625462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.626283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.626592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.628062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50abd17-7079-4aea-b4bc-93c6dc10f178 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.644737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 399/812] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.645910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.646207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.646486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.661785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:25.662971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:25.681517 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f3e57-a370-4ad7-96aa-8edd00c75739 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.714193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.714976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.715266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.715582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.721998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.723439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.725024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 400/813] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:25.725908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.736875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-dc4ed6d0-9b5f-4f42-a099-0c63b9085f7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:25.738046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 414/814] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.739204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.739507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.739791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.757043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:25.758228 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:25.820384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 415/815] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:25.821185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.824673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a5c97-a580-4a89-8d36-496ed7d3a962 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.860687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.861421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.861717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.861996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.862772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:25.863083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.864559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.876187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 401/816] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:25.878568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:25.917601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd7c6e-6ebd-4358-8203-fefa82e05c69 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.951011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:25.951829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:25.952116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:25.952393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:25.962009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:25.963460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:25.970844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95746-3ec6-4801-98c1-05a1f8424d85 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:25.979740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:25.980853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 416/817] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:25.982155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.003268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.003959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.004245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.004521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.005291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.005602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.007049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.018392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 402/818] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.019166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.075777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac3c32-2e8c-401c-82f7-eebbac6ab459 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.112294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25066793-d78f-46b7-b39e-769c2a3e342e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.113179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.113982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.114268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.114547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.115198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.116619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.127432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 12:45:26.128897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 417/819] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Feb 28 12:45:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:26.129678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.145295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.146083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.146556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.146844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] PATH_INFO: `/v3/services/network` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.147519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.148916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.160121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 12:45:26.161283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 403/820] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/services/network => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:26.162031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.223030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2eef5-a612-4f8d-8be0-a2923df4a1c3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.258864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855953-df22-411d-919d-9f7697e110ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.259081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6360e5d-3808-43de-bc8d-365e769bee35 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.259437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855953-df22-411d-919d-9f7697e110ae None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.259749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855953-df22-411d-919d-9f7697e110ae None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.260027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855953-df22-411d-919d-9f7697e110ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.260848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855953-df22-411d-919d-9f7697e110ae None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.261168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855953-df22-411d-919d-9f7697e110ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.262595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855953-df22-411d-919d-9f7697e110ae None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.268291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 418/821] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.269038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855953-df22-411d-919d-9f7697e110ae None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.293192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.293878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.294800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.295084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.295864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.296181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.297670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.310474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 404/822] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.311239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.379372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855953-df22-411d-919d-9f7697e110ae None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.413124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f032120-a938-481e-9b28-a5c2cb635414 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.415501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.416407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.416694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.416990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/83d400660fda46bb810dddd5c79ebdc5/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.433633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=83d400660fda46bb810dddd5c79ebdc5, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.435193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.449295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.449963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.450753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.452987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.452987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.452987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.453600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.457996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 405/823] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.458749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.509694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 419/824] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:26 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/83d400660fda46bb810dddd5c79ebdc5/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:26.510442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.562799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab027b-a518-453c-b328-4da05227a89d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.600281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.600959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.601242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.601517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.602231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] RBAC: Adding query filter params (name=network) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.602543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.604016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.609336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 406/825] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.610256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.618219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732fd4-a162-4dba-bd07-59de807ade2d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.655333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.656190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.656666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.656952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.664544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.666023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.681674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:26.683242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 420/826] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:26.684086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.714329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25345654-800b-4dbb-83ba-3070fb0dfd8f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.748105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.748770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.749056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.749333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.750036 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.750343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.751754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.756975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 407/827] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.757764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.793237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c044942-78f6-4183-b463-f483db86eb38 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.827251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.828002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.828294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.828576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.829290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.829600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.830984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.836244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 421/828] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.837017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.860010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0ddc-0624-4bf1-af37-38fed4bcaf0d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.894306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.894968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.895247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.895543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.896368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:26.896675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.898126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:26.909854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 408/829] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:26.910719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:26.943185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ac355-a125-452b-833a-56d44d5236e6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:26.977957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:26.978616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:26.978907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:26.979184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:26.979961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:26.981422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:27.008348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440284-ba60-4148-8726-e8afb207b306 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:27.040179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:27.040831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:27.041142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:27.041395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:27.042101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:27.043648 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3594-a245-4bd3-a8fa-9411d0859ae1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:27.099507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 422/830] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:27.099507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:27.121541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 409/831] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:27.273606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9ddbf-e3bb-4dc8-8a3d-49f83cb55e26 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:27.329505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:27.330420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:27.330705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:27.330983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/acf32cc208ae41bb83c0248bbcfe74a6/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:27.337161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=acf32cc208ae41bb83c0248bbcfe74a6, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:27.338696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fd42f-67e9-4856-a7c6-107989fb7d53 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:27.413997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 423/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:27 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/acf32cc208ae41bb83c0248bbcfe74a6/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:28.782926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff47b7-d797-4ccb-88ed-8032bb6b8206 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:28.783433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff47b7-d797-4ccb-88ed-8032bb6b8206 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:28.783530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff47b7-d797-4ccb-88ed-8032bb6b8206 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:28.785490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 410/833] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:28.790825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179c51-4e4a-4e24-875b-a25ef21cf88e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:28.791247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179c51-4e4a-4e24-875b-a25ef21cf88e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:28.791416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179c51-4e4a-4e24-875b-a25ef21cf88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:28.808697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b7179c51-4e4a-4e24-875b-a25ef21cf88e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:28.810491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b7179c51-4e4a-4e24-875b-a25ef21cf88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:28.875708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 424/834] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:28.897617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff47b7-d797-4ccb-88ed-8032bb6b8206 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:28.906956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4175-d1a0-40cf-b390-87eaee0a45f4 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:28.907577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4175-d1a0-40cf-b390-87eaee0a45f4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:28.908062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b4175-d1a0-40cf-b390-87eaee0a45f4 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:28.910226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 425/835] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:28.915464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:28.918412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:28.918412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:28.933863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:28.936121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:29.017110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 426/836] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:29.020207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff47b7-d797-4ccb-88ed-8032bb6b8206 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.036892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.056646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.057541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.057888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.058225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.059379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.061715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.074489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 12:45:29.076786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 411/837] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Feb 28 12:45:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:29.083055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.145120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f9792-ba06-4309-ae3a-0c9f4c46a348 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.182037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.182858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.183147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.183427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.196109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:29.205419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:45:29.210040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb857b8-9b5f-4811-bfe8-b9ce08157745 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.211739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 427/838] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:29.213407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.251869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.253194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.253653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.254080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.255298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:29.256057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.257834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.269363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 412/839] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:29.269879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.322293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d762fc-c4c1-45e7-bf45-d4200e9416c3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.355501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.356557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.357060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.357528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.358465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:29.358964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.360555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.369064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 428/840] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:29.370570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b32219-31ea-47ea-b0a7-ba3eeac544fb None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.375606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.407838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.408499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.408786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.409114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.409823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:29.410184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.411640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ed9a2-a794-44ac-8181-8781e7cf15db None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.423498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 413/841] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:29.491685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498b93-f5fd-4719-a2ef-f8411999e5ef None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.527379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.528412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.528703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.528984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.541308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.542943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.545188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353617-d0f4-41ee-a0d9-931e60fed9e0 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.545475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353617-d0f4-41ee-a0d9-931e60fed9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.545756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353617-d0f4-41ee-a0d9-931e60fed9e0 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.547916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 414/842] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:29.557198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.557636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.558020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.563541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:29.565336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 429/843] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:29.571186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.580139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:29.581708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:29.658374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 415/844] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:29.680409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3812-7075-4466-843d-5d8ac1888fa1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.681707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.723298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.723990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.724564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.724854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.725858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:29.726165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.728075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.743437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 430/845] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:29.749906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.793390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c42f3-7540-43f4-bccf-e69528015407 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.829436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.830289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.830526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.830802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.831489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.832899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.844574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6d094482-9b16-47fb-813d-3fe2a848f272 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 12:45:29.845826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 416/846] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:29.846979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909bdcc-6a3b-46a5-b303-b90c218bbb7d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.847326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909bdcc-6a3b-46a5-b303-b90c218bbb7d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.847689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909bdcc-6a3b-46a5-b303-b90c218bbb7d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.849504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 417/847] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:29.852516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909bdcc-6a3b-46a5-b303-b90c218bbb7d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:29.869215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdc451-5b16-41d7-954a-80c710afdcc0 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.902422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.903795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.904096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.904369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.911666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:29.913197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:29.927758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-824bf15e-993a-4ff5-890e-fb3c3a55731b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:29.933509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 431/848] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:29.933509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.933509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:29.933509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:29.946884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:29.948095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:29.961117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909bdcc-6a3b-46a5-b303-b90c218bbb7d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:29.998851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:29.999546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:29.999837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.000117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.000829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.001139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.002527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.011319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 418/849] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:30.011319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.021608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 432/850] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:30.022668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.108913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad75bf4-e07e-4c36-8a2a-2eca718222d2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.125144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df5f06-7f21-4f6a-905f-c7876bb0b7c9 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.140970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.141657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.141924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.142195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.143016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.143324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.144794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.159376 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.160296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.160732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.161156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.161973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 419/851] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:30.162189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.162625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.162871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.164401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.171206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 433/852] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:30.176484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.286372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16b72-a43c-480f-9cc1-c5332d9b7e93 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.307940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d264b-db45-4bdf-9693-bedfbfaf505b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.336192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.337141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.337524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.337901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.352102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.353605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.353905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.354185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.367227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:30.374234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:45:30.375776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 420/853] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:30.381868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.424904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.427008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.485161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab873-87b4-4cdd-bed0-2f80eba0a13d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.519498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.520226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.520511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.520791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.521588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.521935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.523335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.531957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 421/854] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:30.539073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.549061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 434/855] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:30.555898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.654475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927fc00-77cd-45bf-9fcb-3048237357b2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.666841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a8bb9-441c-4122-a225-65713bd98020 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.687986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.688769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.689098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.689375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.699805 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.701288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.707035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.708349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.708707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.709055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.718403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:30.721059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.722614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.723797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 435/856] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:30.725321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.742945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:30.744879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 422/857] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:30.751877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.842586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b766-9349-464e-824f-b4905e3cf988 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.852290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0331fd-d632-4d95-9f22-6199c6d0c4ef None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:30.884168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.884828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.885185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.885393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.886110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.886417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.886777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:30.887574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:30.887841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.888049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:30.888379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:30.891127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:30.891127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:30.891127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:30.901783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 436/858] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:30.904681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 423/859] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:30.912653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:30.913875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.016217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29908d7d-951b-4108-8d38-9165dd31f93e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.036778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364e06-6957-4813-b382-2bcc29160515 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.058552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.059339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.059674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.059948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.072538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.075633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.078428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.079312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.079694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.080043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.087693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.089296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.093447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:31.095201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 437/860] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:31.100593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.105512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 12:45:31.107007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 424/861] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:45:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:31.113172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.209197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc6a-5884-4b2e-bb0e-3cbc0e247f9b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.212494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e45b-c462-47c6-bdd6-96c0fb2ffd29 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.243433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.244450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.244993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.245484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.246406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:31.246854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.247859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.248631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.248944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.249069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.249443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.250382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:31.250793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.252434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.267562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 438/862] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:31.268636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.275520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 425/863] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:31.276410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.370825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171f28-d3b5-4070-b806-1c3730a3c67c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.377814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05a5c-f2c8-4217-ab68-aa0a4908213a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.406041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.406995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.407498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.407933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.408933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=83d400660fda46bb810dddd5c79ebdc5) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:31.409420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.411322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.412904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.413621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.413975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.414323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.423945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 439/864] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/role_assignments?user.id=83d400660fda46bb810dddd5c79ebdc5&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:31.491833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.493259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.603825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 426/865] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:31.605279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.702583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d64a3-470b-4b52-9e06-e25369602c2f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.736020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.736810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.737095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.737371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.747926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.749313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.770215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a5120962-cf56-451b-860a-068c6d789750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:31.771750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 440/866] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:31.777078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.823854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773349-065e-45f1-b22e-4f46c8ddd5a2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.824476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773349-065e-45f1-b22e-4f46c8ddd5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.824957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773349-065e-45f1-b22e-4f46c8ddd5a2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.827798 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 441/867] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:31.833199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.843165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.843165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.854038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:31.855577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:31.892025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e19fa-bdae-4681-8c20-047119ee9cb4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:31.935629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 442/868] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:31.937916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:31.938756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:31.939182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:31.939641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:31.940539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:31.941051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:31.942645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:31.955176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:31.957371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 427/869] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:31.962868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:32.062329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b54b95-5964-4889-9b31-fc7055edbdc6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:32.067894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58028f04-2e4e-4b8b-82ce-5163b2e3d769 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:32.097883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:32.099035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.099588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.100064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.103336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:32.104197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.104653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.105080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.105969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:32.107570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:32.108148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:32.109773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:32.124459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:32.126313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 428/870] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:32.131631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:32.190604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 443/871] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:31 2022] POST /identity/v3/services => generated 269 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:32.254450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eb46e-91f0-428f-b6dd-69eacc855341 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:32.299492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:32.300628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.301129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.301623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.303362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:32.304013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:32.306845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361b82d-afbe-430d-88aa-054cd985d8c6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:32.323038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 429/872] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:32.329803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:32.432593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e267b-3e17-41fd-912e-0313fb53defc None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:32.466707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:32.467367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.467678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.467955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.468777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=acf32cc208ae41bb83c0248bbcfe74a6) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:32.469089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:32.470633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9da19a-de10-4ef9-8f34-acbb9ed8ebfa None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:32.476633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 444/873] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:32 2022] GET /identity/v3/role_assignments?user.id=acf32cc208ae41bb83c0248bbcfe74a6&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:32.543014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784fd-761d-42c1-ace8-4a4727425906 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.543362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784fd-761d-42c1-ace8-4a4727425906 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.543647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784fd-761d-42c1-ace8-4a4727425906 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.546140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 430/874] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:32.552134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd3ab-8239-48ad-b2ed-b1947186a3a0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.552750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd3ab-8239-48ad-b2ed-b1947186a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.553260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd3ab-8239-48ad-b2ed-b1947186a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.572050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2a4dd3ab-8239-48ad-b2ed-b1947186a3a0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:32.573708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2a4dd3ab-8239-48ad-b2ed-b1947186a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:32.646627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 445/875] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:32 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:32.670315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1784fd-761d-42c1-ace8-4a4727425906 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:32.774507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1784fd-761d-42c1-ace8-4a4727425906 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:32.807619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:32.808291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:32.808579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:32.808857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:32.810141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:32.811542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b4f19-ee4d-4b02-994e-2ca3a28ae91e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:32.922587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 431/876] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:32 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:33.853187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa45a-7d86-4c03-b1be-3dbe808daa04 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:33.853705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa45a-7d86-4c03-b1be-3dbe808daa04 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:33.855910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa45a-7d86-4c03-b1be-3dbe808daa04 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:33.855910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 446/877] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:33.861800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:33.862093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:33.862374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:33.879284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:33.880582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:33.959584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 432/878] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:33.979175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa45a-7d86-4c03-b1be-3dbe808daa04 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.087105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa45a-7d86-4c03-b1be-3dbe808daa04 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.121593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.122655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.123091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.123560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.134095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:34.142315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:45:34.147572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 447/879] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:45:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:34.150259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.254440 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a27ff-86dd-49ed-9a1f-3c961653bca0 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.289290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.290184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.290615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.291038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.291965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:34.292441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:34.294000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:34.306663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 433/880] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:34.308220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.408392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7405f-9399-4ab0-ac31-8204fffb0dec None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.442263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.443296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.443753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.444175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.455782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:34.457438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:34.474346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-58face0f-80f4-4400-83ba-f47f7e87f18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:34.479566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 448/881] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:34.481981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.568681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41a001-5622-41ca-a730-9d817897c3cf None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.570022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41a001-5622-41ca-a730-9d817897c3cf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.570530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41a001-5622-41ca-a730-9d817897c3cf None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.573649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 449/882] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:34.580068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.580607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.581109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.593262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf9f1-d752-438c-badc-75d6c0d6068d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.598342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:34.599794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:34.634798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.635506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.635795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.636075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.636800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:34.637117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:34.639067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:34.654363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 434/883] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:34.660300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.671770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 450/884] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:34.701363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.793518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a946b5-c17f-4c66-96af-97d310b3793b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.806069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608609-6d56-4c0c-860d-c65c43b01b0d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.828170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.829025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.829255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.829530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.836543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:34.837990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:34.850783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:34.852084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:34.852599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:34.853088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:34.853954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:34.856820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:34.857293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:34.864411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 435/885] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:34.865287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.871507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 12:45:34.878604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 451/886] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:34.880434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:34.969361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15b38a-d8c3-4c21-91f4-3062061a54f8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:34.984322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818269ba-02ed-421d-8b3c-3a79e0f28991 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.005707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.006640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.006962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.007203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.008070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.008378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.009819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75480a8-8e40-4bcd-b26a-d638acd29c28 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.021609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.022452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.022901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.023342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.024080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.024387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.025755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ce61-e1d4-4041-9118-7a8a1e6e3453 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.026625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 436/887] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.027924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3cd5-b350-456f-80fd-eb2bae6c374b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.028239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3cd5-b350-456f-80fd-eb2bae6c374b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.028513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a3cd5-b350-456f-80fd-eb2bae6c374b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.030273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 437/888] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:35.034837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a3cd5-b350-456f-80fd-eb2bae6c374b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.036049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 452/889] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.037523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.037814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.038092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.055438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:35.056965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:35.127191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 453/890] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:35.128062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.150280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a3cd5-b350-456f-80fd-eb2bae6c374b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.184098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.184770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.185052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.185493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.229997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a285024-7898-4557-85c4-72f168c9dbf5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.251369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.252859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078b761-10b7-4441-b358-ebe7201116a2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.262402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.263062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.263349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.263654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.264362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.264671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.266061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.270766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 454/891] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.271450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.345131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 438/892] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:35.346465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34278-faff-4e7e-8e14-2785849d6bb9 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.346761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34278-faff-4e7e-8e14-2785849d6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.347043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c34278-faff-4e7e-8e14-2785849d6bb9 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.348898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 439/893] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:35.349422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c34278-faff-4e7e-8e14-2785849d6bb9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.365072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4506-b5b2-40c4-90d5-c0eb40d0c24b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.396318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.397105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.397388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.397664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.398314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.399714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.410992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 12:45:35.412175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 455/894] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:35.412927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.443913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c34278-faff-4e7e-8e14-2785849d6bb9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.476485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.477130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.477420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.477693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.478469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] RBAC: Adding query filter params (interface=public, service_id=12dae13bc95442e39f0b09360922a98f, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.478782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.480241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2efb-0855-4c72-b098-5876a4fe1c60 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.485043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 440/895] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/endpoints?service_id=12dae13bc95442e39f0b09360922a98f&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.486191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.486479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.486760 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.502260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:35.503438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:35.507075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd326e-2883-4519-9897-1a9b95f86883 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.538923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.539730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.540011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.540285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.550172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.551653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.565629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 441/896] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:35.566432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.567071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:35.573088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 456/897] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:35.573088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.661497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dce83-8708-4d71-bd66-baa3813f1c08 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.663804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf78a2c-9dc7-4558-9b9b-920f2c78d9cd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.692324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.692965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.693246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.693521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.694184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.695177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.695844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.695938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.696132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.696411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.697116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.697428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.698798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.701942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 457/898] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:45:35.702718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.703882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 442/899] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.704664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.812637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219c3e-38db-4015-bdaa-2d0917b92e61 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.812856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d16cc-068c-4d09-b070-6b9a1a2750db None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.848535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.849483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.849775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.850057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.850670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:35.850785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:35.851091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.851462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:35.851768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:35.852060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:35.852547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.852712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:35.854103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:35.874612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 458/900] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:35.875146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 12:45:35.875236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.875316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 443/901] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:35.875316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:35.967104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d7437-1125-4d50-a0fb-1210f8b45efb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:35.978998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47b86b-0c19-4b55-9eb9-fd73fdb10974 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.001444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.002110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.002403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.002684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.003397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.003736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.005111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.017406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 459/902] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.017406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.027295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.028469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.028759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.029191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.038901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.041325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.061961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:36.067645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 444/903] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:36.070707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.127073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755bfe2-89c6-4db5-91d3-f17c1859acf5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.164495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.165447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.165894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.166324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.167404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.167897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.169497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.174943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 460/904] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.180596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.188302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ef365-e6a0-4955-8097-571f8ae1cb55 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.227398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.228618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.229016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.229392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.230273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.230682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.232981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.246532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 445/905] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.256453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.291535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42846c-ce73-4792-908c-3a5468c9eb85 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.329531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.330519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.331011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.331504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.332463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.333016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.334589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.344631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 461/906] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.345751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.380696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f48c-11fa-4578-a898-03d78e873374 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.419607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.420272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.420566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.420849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.421678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] RBAC: Adding query filter params (role.id=efd61b07dde3439da736cac9bd4c5f76, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=83d400660fda46bb810dddd5c79ebdc5) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.421994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.423455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.435498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 446/907] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/role_assignments?user.id=83d400660fda46bb810dddd5c79ebdc5&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=efd61b07dde3439da736cac9bd4c5f76 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.464375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63e9d-61b3-4859-b46a-0d450f8c5cf6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.501657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.502331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.502620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.502899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.503732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] RBAC: Adding query filter params (interface=public, service_id=a1cfd97c3f9d404c93b288c8b59accef, region_id=RegionOne) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:36.504049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.505537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbcc2e-e019-4998-a83d-4cb76e0b0382 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.511826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 462/908] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/endpoints?service_id=a1cfd97c3f9d404c93b288c8b59accef&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:36.517453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:36.625262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506558-1fcb-4b81-9ebd-35c5d51a55d0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:36.661697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:36.662361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:36.662644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:36.662917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:36.663626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:36.665005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7b18-e98d-4aad-a6c3-a9ffaafcb0ca None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:36.671638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 447/909] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:36 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:45:38.088321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3de8a-410c-4868-9710-9b7dec51b493 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.088861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3de8a-410c-4868-9710-9b7dec51b493 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.088861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3de8a-410c-4868-9710-9b7dec51b493 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.091448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 463/910] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:38.096652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481eb1-d353-4944-a0c9-32de1f7e6e14 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.097056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481eb1-d353-4944-a0c9-32de1f7e6e14 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.097251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481eb1-d353-4944-a0c9-32de1f7e6e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.114218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-af481eb1-d353-4944-a0c9-32de1f7e6e14 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:38.115391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-af481eb1-d353-4944-a0c9-32de1f7e6e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:38.182630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 448/911] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:38.207112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3de8a-410c-4868-9710-9b7dec51b493 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.307533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3de8a-410c-4868-9710-9b7dec51b493 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:38.333791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0373e-a0cd-4240-b5c1-4ed67786702a None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.334096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0373e-a0cd-4240-b5c1-4ed67786702a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.334347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0373e-a0cd-4240-b5c1-4ed67786702a None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.336875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 449/912] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:38.343028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f36fa-e020-419c-a37d-54133994377a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.343604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f36fa-e020-419c-a37d-54133994377a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.344083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f36fa-e020-419c-a37d-54133994377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.346332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:38.347128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.347411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.347717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.348370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:38.349734 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:38.361117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 12:45:38.362589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 464/913] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Feb 28 12:45:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:38.363987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-734f36fa-e020-419c-a37d-54133994377a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:38.365392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-734f36fa-e020-419c-a37d-54133994377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:38.368286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.443620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 450/914] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:38.460926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f36fa-e020-419c-a37d-54133994377a None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.470903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c479387-91c6-42d5-a1d2-c8b1e4b089e2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:38.504917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:38.505571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.505855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.506132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.506848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:38.507135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:38.508540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:38.513425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 465/915] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:38.518793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.563309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f36fa-e020-419c-a37d-54133994377a None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:38.597314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:38.598209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.598638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.599093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.600017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:38.601539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770f86a-6811-4853-93eb-2e12bb517bc2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:38.616050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94315c41-8304-4bcc-9d35-b7c3e4f6b051 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:38.649882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:38.650724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.651091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.651380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.652134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:38.657091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:38.657091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:38.660013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 466/916] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:38.665686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.687503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 451/917] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:38 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:38.781885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6af933-fa82-4967-991f-14b2a7de0d1a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:38.799059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141daf-10e0-4ce8-b2bd-b70d13af76c8 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.799350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141daf-10e0-4ce8-b2bd-b70d13af76c8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.799685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e141daf-10e0-4ce8-b2bd-b70d13af76c8 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.805701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 452/918] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:38.807547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.807848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.808137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.824702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:38.825403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:38.825686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:38.825958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:38.826767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:38.827172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:38.828297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230295-1f5a-4c56-a7dc-c56ad376bf26 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:38.834421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:38.905942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 453/919] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:38.929246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:38.932601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 467/920] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:39.026603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656b5c-fb45-4347-aa56-64c660b3b1eb None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.026961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656b5c-fb45-4347-aa56-64c660b3b1eb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.027962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656b5c-fb45-4347-aa56-64c660b3b1eb None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.030611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 468/921] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:39.035377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.035656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.035949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.054166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:39.054675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b1c96-2605-4712-b189-78dcf5c10871 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.055391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:39.102891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023154-c446-402f-93a1-1347345a667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.103814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023154-c446-402f-93a1-1347345a667d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.104101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023154-c446-402f-93a1-1347345a667d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.104376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023154-c446-402f-93a1-1347345a667d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.116452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed023154-c446-402f-93a1-1347345a667d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:39.124900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ed023154-c446-402f-93a1-1347345a667d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:45:39.126577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 454/922] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:45:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:39.132526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023154-c446-402f-93a1-1347345a667d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.139172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 469/923] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:39.163540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.235221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023154-c446-402f-93a1-1347345a667d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.269152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.269906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.270338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.270653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.271507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:39.271946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.273431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.275357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2a23-939e-40eb-be92-16b8fd4b67b2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.281779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 455/924] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:39.287173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.313568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.314779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.315267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.315777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.316703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.318531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.330544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 12:45:39.332320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 470/925] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:39.337829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.386968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf838-6cc1-4955-85aa-181ccf792328 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.420680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615494-f099-4703-a600-2190522abe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.421493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615494-f099-4703-a600-2190522abe1a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.421773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615494-f099-4703-a600-2190522abe1a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.422046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615494-f099-4703-a600-2190522abe1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.433214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2615494-f099-4703-a600-2190522abe1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.435320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2615494-f099-4703-a600-2190522abe1a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.441301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3a5cc-9004-4f36-adff-3b9c6f506a44 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.452089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b2615494-f099-4703-a600-2190522abe1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:39.457880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 456/926] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:39.458711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615494-f099-4703-a600-2190522abe1a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.476528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5041f-5292-4217-b166-112eab85557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.477530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5041f-5292-4217-b166-112eab85557d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.478077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5041f-5292-4217-b166-112eab85557d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.478608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5041f-5292-4217-b166-112eab85557d None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.479546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5041f-5292-4217-b166-112eab85557d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:39.480077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5041f-5292-4217-b166-112eab85557d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.482224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5041f-5292-4217-b166-112eab85557d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.487661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 471/927] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:39.495620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5041f-5292-4217-b166-112eab85557d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.572605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615494-f099-4703-a600-2190522abe1a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.610562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5041f-5292-4217-b166-112eab85557d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.611783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.612616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.613050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.613476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.614360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:39.614818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.616368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.630813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 457/928] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:39.636681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.644697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.645414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.645699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.646030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.646740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:39.647047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.648450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.654044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 472/929] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:39.660419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.754523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555665-7b01-412b-8006-a9cc45bf6dc0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.772713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4299a-7d18-4a50-b871-9b3ee61c5856 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.798551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.800315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.800820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.801462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.806907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.807601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.807890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.808169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.808912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.810392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.811525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.813336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:39.829752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:39.831073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 458/930] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:39.836477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:39.915627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 473/931] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:39.951504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152480-5a00-4fec-a9bc-51e825d21f8c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:39.993016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:39.993796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:39.994080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:39.994401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:39.995239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:39.995602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:39.997179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.018057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 459/932] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:40.023828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:40.128973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec52a-b96b-46dc-8c84-342ef7e21de9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:40.165193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:40.166762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:40.167252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:40.167761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:40.178996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:40.180952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.200304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:40.202304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 474/933] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:40.211513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:40.307009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbb181-a9c2-4b25-97e1-a0e441097d15 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:40.341539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:40.342198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:40.342483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:40.342758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:40.343487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:40.343798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:40.345177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.356690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 460/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:40.362054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:40.468941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b14e5-2842-4dc8-aadb-cd03b548d632 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:40.502104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:40.502939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:40.503231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:40.503529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:40.510300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:40.511787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.526649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:40.528224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 475/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:40.533583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:40.632292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110f598-e649-4fd3-9369-39e42bc336a4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:40.665746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:40.666402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:40.666684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:40.666958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:40.667762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:40.668066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:40.669532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d417c1-8b81-4f36-9eed-ae75b1a90153 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.681768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 461/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:40.688074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:40.784532 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6803a-1776-4843-aa42-3c3b946f3eff None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:40.823706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:40.824599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:40.824913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:40.825187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/83d400660fda46bb810dddd5c79ebdc5/roles/efd61b07dde3439da736cac9bd4c5f76` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:40.827437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=83d400660fda46bb810dddd5c79ebdc5, role_id=efd61b07dde3439da736cac9bd4c5f76)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:40.828922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687192-0fea-4d0b-8888-3b887f42db04 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:40.944004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 476/937] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:40 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/83d400660fda46bb810dddd5c79ebdc5/roles/efd61b07dde3439da736cac9bd4c5f76 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:45:41.176411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6f06-b2a0-4a80-82f8-6d9f2c078137 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.176763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6f06-b2a0-4a80-82f8-6d9f2c078137 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.177002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6f06-b2a0-4a80-82f8-6d9f2c078137 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.179038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 462/938] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:41.184554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc526-f58c-4e07-a8ab-d6e0c2c10a15 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.184990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc526-f58c-4e07-a8ab-d6e0c2c10a15 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.185154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc526-f58c-4e07-a8ab-d6e0c2c10a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.202425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-578bc526-f58c-4e07-a8ab-d6e0c2c10a15 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:41.203648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-578bc526-f58c-4e07-a8ab-d6e0c2c10a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:41.272327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 477/939] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:41.297809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6f06-b2a0-4a80-82f8-6d9f2c078137 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.383122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5421-e017-4ff7-a370-c6f542c0af2a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.383495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5421-e017-4ff7-a370-c6f542c0af2a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.383802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5421-e017-4ff7-a370-c6f542c0af2a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.385918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 478/940] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:41.391778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.392074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.392357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.400783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6f06-b2a0-4a80-82f8-6d9f2c078137 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.409419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:41.410606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:41.442322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.443312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.443781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.444201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.445426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.447683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.462415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 12:45:41.464120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 463/941] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:41.470691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.487627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 479/942] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:41.506420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.587248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485308-0d52-4720-a673-9afdef8e74e9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.608342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eab6f-12f5-4077-abb1-ba0d299d7535 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.622085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.622753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.623046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.623329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.624116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:41.624439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.625830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.630947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 464/943] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:41.640632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.642862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.643810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.644198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.644576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.645350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.646812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.658302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 12:45:41.659912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 480/944] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:41.665766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.759204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea1549-1113-425a-8dc5-06ec7a3cd465 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.779386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb6901-2663-44fc-8cf6-373f680df02a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.794161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.794656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.794944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.795226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.795992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:41.796296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.797683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.807708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 465/945] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:41.809090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.818069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.819003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.819752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.821755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.822907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:41.823422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.825631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.831207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 481/946] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:41.841298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.910254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af9560-dd80-4968-a390-39b06af11ecd None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.942176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a535-3dc3-4681-bd96-f49cfe8d3651 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:41.950565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.951415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.951875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.952328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.953261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] RBAC: Adding query filter params (interface=public, service_id=f7e922f522a443bba646c0b69c73b42e, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:41.953723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.955281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.965378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 466/947] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/endpoints?service_id=f7e922f522a443bba646c0b69c73b42e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:41.966803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:41.978848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:41.979305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:41.979629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:41.979973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:41.980711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] RBAC: Adding query filter params (type=compute) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:41.981079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:41.982583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6eb816-f326-4102-b83e-fc78b418250a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:41.988671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 482/948] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:42.086053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67eaf-0bcb-4cca-a165-d57bd4375a0f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:42.123262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:42.124229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:42.124666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:42.125114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:42.125971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:42.127607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113f0ce-c2b8-4f78-b420-cfd509e97cdf None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:42.139628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 467/949] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:41 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 12:45:42.352900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067dbd-e84e-475e-83d8-79aeac9758a6 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:42.353386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067dbd-e84e-475e-83d8-79aeac9758a6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:42.353386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067dbd-e84e-475e-83d8-79aeac9758a6 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:42.355372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 483/950] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:42.361165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:42.361596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:42.361777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:42.381350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:42.382839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:42.448900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 468/951] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:42.471999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067dbd-e84e-475e-83d8-79aeac9758a6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:42.571284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067dbd-e84e-475e-83d8-79aeac9758a6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:42.604415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:42.605353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:42.605842 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:42.606904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:42.607856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:42.609470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:42.611078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.common [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 12:45:42.696887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.sql.core [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 12:45:42.696887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 12:45:42.696887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [parameters: {'id': '705fda8986b14dab9b3423f16219c57c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 12:45:42.696887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79575) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 12:45:42.713313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 705fda8986b14dab9b3423f16219c57c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 705fda8986b14dab9b3423f16219c57c. Feb 28 12:45:42.715897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 484/952] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Feb 28 12:45:42 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:42.721969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:42.820341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2e47-0b69-4269-8a4f-1cefb2cf1424 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:42.854919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:42.855791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:42.856705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:42.859928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:42.864086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:42.865558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:42.879061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-7c929272-8278-4146-b44c-9674e2df48d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:42.880616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 469/953] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:42.886429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:42.990074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1b25-e8c4-4af6-a0d4-33e2c3b1d3e9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:43.024407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:43.025462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:43.025951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:43.026430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:43.027388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:43.027970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:43.029850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe4e6-c9a8-4972-b73d-8cd98cdcd501 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:43.050990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 485/954] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:43.431385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514114be-7650-473e-8a8c-94bfbc467b25 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:43.431924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514114be-7650-473e-8a8c-94bfbc467b25 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:43.432001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514114be-7650-473e-8a8c-94bfbc467b25 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:43.434049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 470/955] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:43.439397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:43.440285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:43.440796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:43.458472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:43.460328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:43.531155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 486/956] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:43.554703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514114be-7650-473e-8a8c-94bfbc467b25 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:43.659802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514114be-7650-473e-8a8c-94bfbc467b25 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:43.693463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:43.694202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:43.694771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:43.695036 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:43.706341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:43.713654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:45:43.715194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 471/957] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:43.721595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:43.823289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204263-1710-4dd6-bde3-a082725ee159 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:43.858825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:43.859533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:43.859827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:43.860108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:43.861205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:43.861531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:43.862917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:43.872618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 487/958] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:45:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:43.877973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:43.990833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87152d1c-aecc-4c97-be42-ba2a59b329a7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.024717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.025539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.025825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.026103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.038307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.039927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.057883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:44.063595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 472/959] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:44.065147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.169050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aee86-98fa-4462-a8b7-8be4345f5975 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.205727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.206329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.206618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.206898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.207668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:44.207981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.209394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.223186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 488/960] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:44.228789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.333084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd3caf-a237-4537-b12c-ed83c284d286 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.369263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.370075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.370368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.370651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.378015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.379503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.393744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-26d3b896-c9a4-4eb9-b4b5-336f239dc6dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 12:45:44.399630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 473/961] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:44.401106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.403310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058685c-4191-4ded-8300-cc03c64aaf84 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.403637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058685c-4191-4ded-8300-cc03c64aaf84 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.403960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058685c-4191-4ded-8300-cc03c64aaf84 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.405900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 474/962] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:44.411101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.411595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.412040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.429211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:44.430600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:44.503645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 475/963] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:44.521496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6315c-0c6b-45a9-9aeb-e824f8bc6fc9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.521984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.564613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783085-b768-4630-b344-65977743ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.565788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783085-b768-4630-b344-65977743ec1c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.566183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783085-b768-4630-b344-65977743ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.566563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783085-b768-4630-b344-65977743ec1c None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.567684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783085-b768-4630-b344-65977743ec1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:44.568108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783085-b768-4630-b344-65977743ec1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.570663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783085-b768-4630-b344-65977743ec1c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.595941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 489/964] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:44.597490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2500-597c-4c0a-b8a1-0694fe5e1ddb None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.597792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2500-597c-4c0a-b8a1-0694fe5e1ddb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.598079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e2500-597c-4c0a-b8a1-0694fe5e1ddb None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.599976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 490/965] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:44.600620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2500-597c-4c0a-b8a1-0694fe5e1ddb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.626107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a68f4-fe77-44f3-a012-7520abda20fc None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.660498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.661163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.661453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.661735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.662468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.663908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d398a-b625-4d15-a85e-b44c7f02b8a9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.700455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e2500-597c-4c0a-b8a1-0694fe5e1ddb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:44.739538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:44.739743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 476/966] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:44 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:44.740202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.740538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.740821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.741073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:44.741365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:44.741643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:44.771784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:44.771784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:44.830623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:44.832654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:44.863647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 477/967] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:44.890291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:44.962741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 491/968] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:44.970576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.000335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04445-0045-4609-ac7d-b3870bc276f7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.036338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.037446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.037900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.038312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.039119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.040731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.054250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 12:45:45.055972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 478/969] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:45.062727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.089941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157fc16-4c00-4873-a0e1-847627e9cfe9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.139619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.140426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.140718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.141000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.153971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.155910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.171091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e147377-a9eb-462b-8442-d35d2353258b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.178541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:45.183549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 492/970] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:45.185453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.211379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.212084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.212369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.212649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.213354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:45.213660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.215289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.225243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 479/971] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:45.226136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.310785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ecdae-768a-4f78-a81e-8dbcc8646979 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.342310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e3711-83b8-48a2-ab9c-ded3e2e95b77 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.345630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.346095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.346383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.346672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.347392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:45.347728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.349096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.364985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 493/972] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:45.365906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.384618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.385621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.386165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.387641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.388927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:45.389470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.391860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.399098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 480/973] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:45.405456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.474028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486011b4-468c-458f-994b-4c6e719ace54 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.502045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac519-3c5b-47d2-8a7b-7a441a52a65d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.506336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.507127 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.507415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.507728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.514795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.516268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.529967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-a988cfe9-57d1-49b2-84c8-da7b32f4bfb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:45.536053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 494/974] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:45.536053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f812e-dcb0-420a-8e3e-17b8e822a5a0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.536053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f812e-dcb0-420a-8e3e-17b8e822a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.536053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f812e-dcb0-420a-8e3e-17b8e822a5a0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.536053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 495/975] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:45.539501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f812e-dcb0-420a-8e3e-17b8e822a5a0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.541941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.542605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.542892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.543172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.543983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.545439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c68f-753b-46f3-8555-a9620732bd29 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.636323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f812e-dcb0-420a-8e3e-17b8e822a5a0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.655506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 481/976] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:45.655506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.655506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.655506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.673593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:45.674901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:45.678873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.679571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.679858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.680136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.680937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:45.681248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.682813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.697346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:45.704301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.759933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 482/978] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:45.780079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:45.840448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97182b90-6e35-4ec3-ab7b-26af8d5c068d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.882469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.882822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.883111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.883390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.885824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] RBAC: Adding query filter params (role.id=efd61b07dde3439da736cac9bd4c5f76, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=83d400660fda46bb810dddd5c79ebdc5) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:45.886138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.890974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.892257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01589-273c-4b50-a454-1d569133ad04 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:45.898723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 497/979] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:45 2022] GET /identity/v3/role_assignments?user.id=83d400660fda46bb810dddd5c79ebdc5&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=efd61b07dde3439da736cac9bd4c5f76 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:45.940827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:45.941962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:45.942504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:45.942985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:45.943958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:45.945923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:45.947661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.common [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 12:45:45.994250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.sql.core [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 12:45:45.994250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 12:45:45.994250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [parameters: {'user_id': 'c8087fc5ef7048338350278f18d367ae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 12:45:45.994250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79576) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 12:45:46.001222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 12:45:46.002966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 483/980] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Feb 28 12:45:45 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:46.008957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:46.115891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c790c-4088-46d5-b3a5-888b4a1cd7e1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:46.150136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:46.151163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:46.151694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:46.152203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:46.160561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:46.162164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:46.176152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-b171756a-ed65-48ff-980e-80366b4441c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 12:45:46.177802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 498/981] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:45:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:46.183914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:46.282799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8688bc-dbd9-467c-94f8-77f8ae58a961 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:46.316634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:46.317304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:46.317591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:46.317870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:46.318670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:46.318981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:46.320922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6fedb-8229-4c57-8e95-ce1329b9613c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:46.360117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 484/982] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Feb 28 12:45:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:47.111426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9d39-72cd-4b64-88a6-6600f9d3426a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.111982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9d39-72cd-4b64-88a6-6600f9d3426a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.111982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9d39-72cd-4b64-88a6-6600f9d3426a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.113931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 499/983] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:47.119504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.120001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.120073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.139508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:47.141028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:47.204469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 485/984] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:47.227452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9d39-72cd-4b64-88a6-6600f9d3426a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:47.322771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9d39-72cd-4b64-88a6-6600f9d3426a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:47.354159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:47.354938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.355218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.355508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.356181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:47.357536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:47.367943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 12:45:47.369249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 500/985] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:47.375452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:47.470613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a784bd1-829a-49a0-9933-3d581239dc58 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:47.502889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:47.503576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.503860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.504132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.504828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] RBAC: Adding query filter params (name=compute) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:47.505130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:47.506492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:47.515795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 486/986] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:47.517180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:47.612746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc19226-9b5d-46ac-82f4-9460a2633bcb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:47.644408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:47.645071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.645358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.645637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.646338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:47.646645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:47.648106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:47.657682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 501/987] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:47.658630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:47.756880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96604fe2-f85d-4f25-8950-f238e66dfcef None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:47.788042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:47.788692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.788976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.789250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.790033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] RBAC: Adding query filter params (interface=public, service_id=432afeb5c68045ab8e368b4279630744, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:47.790340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:47.791733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d35b15-acd6-49db-b4d1-c8e185aa4449 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:47.803531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 487/988] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:47 2022] GET /identity/v3/endpoints?service_id=432afeb5c68045ab8e368b4279630744&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:47.803692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:47.898313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd847d-ede2-4d53-9271-ab90a076df02 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:47.930944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:47.931656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:47.931940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:47.932213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:47.932907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:47.934367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029c68d-a3dd-47a0-96e6-7f9417ba4380 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:47.947577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 502/989] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:47 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 12:45:48.051704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f4af-5e4d-40e7-914f-c1ad912968ba None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.052001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f4af-5e4d-40e7-914f-c1ad912968ba None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.052196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72f4af-5e4d-40e7-914f-c1ad912968ba None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.054192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 488/990] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:48.060018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4324-85fa-424f-bb00-22b65b654860 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.060318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4324-85fa-424f-bb00-22b65b654860 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.060607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4324-85fa-424f-bb00-22b65b654860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.078479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-59cc4324-85fa-424f-bb00-22b65b654860 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:48.079739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-59cc4324-85fa-424f-bb00-22b65b654860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:48.153518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 503/991] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:48.172476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72f4af-5e4d-40e7-914f-c1ad912968ba None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.269163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72f4af-5e4d-40e7-914f-c1ad912968ba None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.301600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f684db9-43aa-4448-b390-1c37fa4ac248 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.302090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f684db9-43aa-4448-b390-1c37fa4ac248 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.302192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.302295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f684db9-43aa-4448-b390-1c37fa4ac248 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.302944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.303228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.303527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.304108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 504/992] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:48.304220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.305577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.309076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.309354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.309637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.317157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 12:45:48.318791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 489/993] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:48.325123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.327044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:48.328277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:48.394352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 505/994] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:48.416095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.424597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e9d-a487-4b0f-8219-2ca0657aa6f2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.456960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.457625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.457914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.458200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.458907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:48.459219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.460658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.465448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 490/995] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:48.471008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.512277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f0987-93ba-4928-a4e9-c081a2e9291d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.544802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.545582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.545862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.546135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] PATH_INFO: `/v3/services/image` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.546784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.548174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.558682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 12:45:48.563514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 506/996] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:48.566222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.567628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d87f-511a-4d6d-856b-caeb5074f1b7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.600027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.600684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.600966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.601238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.601996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:48.602299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.603779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.609392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 491/997] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:48.615000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.662428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c24383-0bbe-4c4a-9a87-5b029a1f5375 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.695752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.696413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.696703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.696983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.697855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] RBAC: Adding query filter params (name=image) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:48.697977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.699355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.704380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 507/998] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:48.710072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.713169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250fe4d-1956-4847-bbbe-f4a3d8dae2f0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.747026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.747721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.748007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.748285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.749108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] RBAC: Adding query filter params (interface=admin, service_id=f7e922f522a443bba646c0b69c73b42e, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:48.749393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.750879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.755956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 492/999] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/endpoints?service_id=f7e922f522a443bba646c0b69c73b42e&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:48.761246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:48.805910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8700df-11a6-473e-879b-92fef685da81 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.838337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.839322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.839744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.839928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.841161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:48.841472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.842837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108082-83f8-42ae-b5a9-0fed2cafa1c7 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.847562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 508/1000] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:48.858459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c794-dc5a-42c0-ba63-e56e92137079 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:48.894180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:48.894856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:48.895143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:48.895421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:48.896225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:48.897622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47bc6-5f94-492b-ae80-06aa848073fe None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:48.905202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 493/1001] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:48 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 12:45:50.273826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f5f2-5b05-4418-9a4a-71af29d6106c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.274314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f5f2-5b05-4418-9a4a-71af29d6106c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.274314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f5f2-5b05-4418-9a4a-71af29d6106c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.279513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 509/1002] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:50.281441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.281828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.282009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.298707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:50.299946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:50.366303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 494/1003] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:50.390244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f5f2-5b05-4418-9a4a-71af29d6106c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:50.488157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f5f2-5b05-4418-9a4a-71af29d6106c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:50.520527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:50.521319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.521605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.521878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] PATH_INFO: `/v3/services/compute` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.522527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:50.524000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:50.534618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 12:45:50.540615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 510/1004] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:50.541861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:50.637054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1555-b3e3-49d3-970d-e0e880deacc9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:50.669464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:50.670135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.670423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.670702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.671411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:50.671762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:50.673145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:50.678011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 495/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:50.683412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:50.780314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209973-fcbe-4d10-9bca-e26006dc8cce None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:50.814829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:50.815507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.815797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.816073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.816774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] RBAC: Adding query filter params (type=compute) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:50.817201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:50.818571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac973ea-f5b1-4f41-a52a-d7a92fb0efba None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:50.829633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 511/1006] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Feb 28 12:45:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:50.829798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:50.932349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebed1-9d9f-4699-a848-19efecb5e639 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:50.966232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:50.966906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:50.967193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:50.967496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:50.968241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:50.969671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaf99-c7b4-4079-85d0-c690f6be7d08 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:51.047111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 496/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:51.130155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef8c-e6d4-422e-8aa0-89f62919bd56 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.130510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef8c-e6d4-422e-8aa0-89f62919bd56 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.130720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef8c-e6d4-422e-8aa0-89f62919bd56 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.132597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 512/1008] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:51.138365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.138651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.138935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.157037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:51.158239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:51.223779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-494d-4cce-bde2-6a756ae5a7cd None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.224086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-494d-4cce-bde2-6a756ae5a7cd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.224338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eae04-494d-4cce-bde2-6a756ae5a7cd None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.226101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 513/1009] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:51.231524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.231817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.232099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.236025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 497/1010] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:51 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:51.249372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:51.250569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:51.259002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:51.319891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 514/1011] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:51 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:51.344064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:51.358867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc736d28-131a-49f0-b9f5-db7fd9236a89 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:51.392374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:51.393045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.393328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.393649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.394382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:51.395824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:51.442333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bf854-c482-4a98-8ea2-0705435079ba None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:51.478120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:51.479306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.479851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.480327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.481270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:51.482862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:51.494617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 12:45:51.501289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 515/1012] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Feb 28 12:45:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:51.502119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:51.505074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 498/1013] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:51 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:51.611740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c90f2-fcaf-42fd-8966-1ae3ca49f18f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:51.653080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:51.653759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.654043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.654319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.655046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:51.655346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:51.656801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:51.662386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 516/1014] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:51.668884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:51.771267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a3e45-01a2-4d68-b689-f4f44f4b1b55 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:51.804737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:51.805410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.805698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.805976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.806688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:51.806996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:51.808431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6bce0-6488-4af3-9200-788b62ec7169 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:51.815861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 499/1015] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Feb 28 12:45:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:51.822013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:51.920412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dcd7d-bb59-49b6-afc7-74a3cd2d3f37 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:51.957789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:51.958664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:51.959112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:51.959573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:51.960472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:51.962014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c24989-03f9-41af-8ccb-d74edf196c41 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:52.039510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 517/1016] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:53.430137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3bce-3b1d-41f1-a376-3cd5eb378009 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.430653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3bce-3b1d-41f1-a376-3cd5eb378009 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.430757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3bce-3b1d-41f1-a376-3cd5eb378009 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.432645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 500/1017] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:53.438095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.438476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.438662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.455980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:53.457148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:53.529429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 518/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:53.552562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3bce-3b1d-41f1-a376-3cd5eb378009 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:53.650762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3bce-3b1d-41f1-a376-3cd5eb378009 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:53.682867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:53.683634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.684489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.684770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.695461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:53.703057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-19b6cee9-6ec8-4b9e-bd35-3a22e2d50033 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:45:53.704450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 501/1019] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:45:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:53.710241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:53.802842 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d237644-1c26-40b6-9229-6a5a3399e1a5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:53.835116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc0ae-c299-427a-b649-87ea340aa5fe None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.840865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc0ae-c299-427a-b649-87ea340aa5fe None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.840865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacc0ae-c299-427a-b649-87ea340aa5fe None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.841050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323262a-973f-4541-841d-767345436e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:53.841050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323262a-973f-4541-841d-767345436e7c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.841050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323262a-973f-4541-841d-767345436e7c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.841050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323262a-973f-4541-841d-767345436e7c None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.841322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 502/1020] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:53.841392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323262a-973f-4541-841d-767345436e7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:53.841392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323262a-973f-4541-841d-767345436e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:53.841392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323262a-973f-4541-841d-767345436e7c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:53.843144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:53.843442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:53.843749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:53.853917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 519/1021] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:53.854858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323262a-973f-4541-841d-767345436e7c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:53.865708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:53.868884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:54.002641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 503/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:45:54.025614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.034003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323262a-973f-4541-841d-767345436e7c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.066559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.067343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.067657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.067938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.078373 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.079850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.096317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:54.097776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 520/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:54.102994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.122299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422125-ed5b-42b7-a77d-92549fdcf94b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.155406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.156236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.156519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.156796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] PATH_INFO: `/v3/services/image` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.157474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.158854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.170092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 12:45:54.171458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 504/1024] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:54.177137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.203191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42162-bc99-49ea-bfbd-9c5665e7b227 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.237189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.238082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.238513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.238927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.239824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:54.240303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.241828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.253654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 521/1025] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:54.259085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.276618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ce9cf-f65b-4e04-9bb6-9c003583c624 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.310179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.310840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.311127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.311405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.312134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:54.312443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.313823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.318531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 505/1026] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:54.325175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.355705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c5be-e7b4-496d-96b2-dcc366683ad9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.386721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.388057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.388342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.388619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.396253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.398943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.415100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-eaf5884f-93db-4105-8531-8b73d86ac8aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:54.416306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 522/1027] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:54.417648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20505a3-1d01-427c-bf24-5983ee00a7ed None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.417942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20505a3-1d01-427c-bf24-5983ee00a7ed None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.418248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20505a3-1d01-427c-bf24-5983ee00a7ed None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.418358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9181fb-4d42-43a6-80d2-920acb5e1bb2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.420095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 523/1028] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:54.421786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20505a3-1d01-427c-bf24-5983ee00a7ed None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.450689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.451356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.451668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.451941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.452636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] RBAC: Adding query filter params (type=image) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:54.452942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.454348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04c894-fbc6-4d81-8f7f-18d299a87824 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.458843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 506/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:54.460023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.460307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.460580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.476687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:54.477972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:54.516995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20505a3-1d01-427c-bf24-5983ee00a7ed None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.540158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 507/1030] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:54.540983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.549406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.550073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.550356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.550631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.551458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:54.551817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.553254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.570050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 524/1031] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:54.570770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.634945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb04b5-d290-4ef1-86ab-3fed206889ea None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.662424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508af8e-f523-4a53-972a-04223e8971b7 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.666362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.667008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.667287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.667595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.668402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] RBAC: Adding query filter params (interface=public, service_id=d0e78b831d91432488d16ffa425e4b9e, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:54.668714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.670171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.674908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 508/1032] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/endpoints?service_id=d0e78b831d91432488d16ffa425e4b9e&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:54.675692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.695332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.696151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.696444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.696718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.697871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.699308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.701578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 525/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:54.702184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.771080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6301a6-53dd-4b88-a1fd-51f83b2a6396 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.792357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f2cf-f961-4022-805f-797b17cca9b2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.801884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.802518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.802800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.803075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.823930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.825118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.825397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.825668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.826331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.827725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.834090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 526/1034] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/services => generated 1957 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:45:54.834664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:54.881822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.883298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.938069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c612-267d-4f94-9534-c4c9406a050f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:54.974737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:54.975401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:54.975711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:54.975986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:54.976696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:54.978134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:54.995205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 509/1035] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:45:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:45:55.001667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:55.063646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 527/1036] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:45:54 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:45:55.106542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd26c8-ae71-46a4-92d0-ee429a8480a7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:55.142708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:55.143547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:55.143837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:55.144116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:55.154990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:55.156574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:55.174758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:55.176257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 510/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:55.181786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:55.284648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8059db6-7f53-4154-b401-50c876e9e89d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:55.318677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:55.321323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:55.321323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:55.321323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:55.321323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:55.321323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:55.322545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:55.334646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 528/1038] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:55.340942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:55.435575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3ae72-9d95-4f52-895d-f6e201242a52 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:55.468529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:55.469390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:55.469678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:55.469959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:55.476701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:55.478160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:55.491508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:55.497748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 511/1039] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:45:55.499104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:55.598022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf114c5-5681-4508-bee5-8a0d89fb4ca6 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:55.631563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:55.632222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:55.632512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:55.632792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:55.633580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:55.633893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:55.636182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4cc28-a660-4a71-a055-36d5aa17584f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:55.647755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 529/1040] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:55.653956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:55.750380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ccf16-606f-464b-9f58-d3b1711c2a0c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:55.781789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:55.782448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:55.782734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:55.783013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:55.783860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] RBAC: Adding query filter params (role.id=efd61b07dde3439da736cac9bd4c5f76, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:55.784177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:55.785618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e46ab-dc01-43fb-858d-9c655f08d05b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:55.799504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 512/1041] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:45:55 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=efd61b07dde3439da736cac9bd4c5f76 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:57.120254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198afe8-71b7-4ec3-bdcd-55a85fba67ad None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.120763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198afe8-71b7-4ec3-bdcd-55a85fba67ad None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.120840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198afe8-71b7-4ec3-bdcd-55a85fba67ad None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.123111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 530/1042] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:57.128660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c066-cacf-4e8c-88af-7e042858c6f6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.129068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c066-cacf-4e8c-88af-7e042858c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.129221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c066-cacf-4e8c-88af-7e042858c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.146424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-eb95c066-cacf-4e8c-88af-7e042858c6f6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:57.147658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eb95c066-cacf-4e8c-88af-7e042858c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:57.211190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 513/1043] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:57.235013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198afe8-71b7-4ec3-bdcd-55a85fba67ad None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.332330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198afe8-71b7-4ec3-bdcd-55a85fba67ad None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.366518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.367494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.367791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.368071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] PATH_INFO: `/v3/services/image` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.368729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.370111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.379329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214ed3-2ce5-412d-b971-f091b0f5a720 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.379656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214ed3-2ce5-412d-b971-f091b0f5a720 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.379940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74214ed3-2ce5-412d-b971-f091b0f5a720 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.381353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 12:45:57.381852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 514/1044] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:45:57.387314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 531/1045] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Feb 28 12:45:57 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:57.387453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.387453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.387453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.388208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.403243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:57.404463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:57.475677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 515/1046] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:57.484845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e5057-78e4-479e-9d27-064054262a8e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.500789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.517931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.518591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.518876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.519153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.519883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] RBAC: Adding query filter params (name=image) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:57.520192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.521555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.526529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 532/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:57.531855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.596122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01ef6-492b-4029-bac8-e9127f52b010 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.627980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027ae80-d5c2-4664-a830-71355a47cd9f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.632310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.633100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.633381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.633655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.634822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.636301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.637941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 516/1048] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:57.643312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.663525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.664191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.664479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.664758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.665461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] RBAC: Adding query filter params (type=image) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:57.665768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.667133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.677276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 533/1049] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:57.678068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:57.750765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32e4d3-cad6-4337-9280-8f8146d759d8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.778246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fda3a-e39d-4c7e-976b-b7cde1da556f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:57.783892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.784564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.784850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.785125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.785825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.787262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eb5ce-478f-4165-82e4-a02572dfcd49 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.811612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:57.812264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:57.815845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:57.815845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:57.815845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:57.815845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ea6e-ee0a-455d-a294-c256a2b0d9d1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:57.885236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 517/1050] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:45:57 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:57.939501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 534/1051] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:45:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:45:58.078417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0f3-bcb1-4beb-8338-899832f99a5e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.080573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0f3-bcb1-4beb-8338-899832f99a5e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.080573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0f3-bcb1-4beb-8338-899832f99a5e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.081256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 518/1052] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:45:58.087068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.087352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.087803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.106248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:45:58.109251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:45:58.184062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 535/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:45:58.206504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b0f3-bcb1-4beb-8338-899832f99a5e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:58.307020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b0f3-bcb1-4beb-8338-899832f99a5e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:58.341506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:58.342268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.342530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.342807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.353255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:45:58.360749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:45:58.362175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 519/1054] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:58.367944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:58.462498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf40201-2737-4135-82d2-1dcb4db93a5a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:58.493910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:58.494572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.494860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.495140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.495909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:58.496759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:58.498132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:58.505948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 536/1055] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:58.511570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:58.613131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8c58-0c86-40f5-a637-2a554ba380a8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:58.647884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:58.648680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.648966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.649243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.659332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:58.660841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:58.677727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:58.679091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 520/1056] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:58.685310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:58.781895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f498b-9fe1-4046-bb93-6a98c5284495 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:58.814417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:58.815080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.815367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.815672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.816388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:58.816699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:58.818160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:58.830265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 537/1057] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:58.835867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:58.932308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db7f3-e58c-4a8c-8330-4ce3d679bb82 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:58.968080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:58.968881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:58.969168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:58.969453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:58.976782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:58.978243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:58.992193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:45:58.993531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 521/1058] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:58.999838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.096864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedae90-8e01-468e-ab85-c29c2f1af70b None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.131706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.132375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.132664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.132944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.133774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:59.134085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.135531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.157215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 538/1059] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:45:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:59.158447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.253223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa0272-4e40-4d91-ae60-a1960a1d9dbd None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.285382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.286163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.286566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.286846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.296880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.298336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.314140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:45:59.315496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 522/1060] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:59.321263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.416027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8607d5-9b0e-41df-b369-d14861cdd27d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.448846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.450042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.450330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.450614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.451326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:59.451659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.453023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.463951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 539/1061] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:45:59.469930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.565991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb4f89-68c2-4010-ab38-28892f3cc38d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.598701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.599512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.599799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.600073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.606635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.608177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.620600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:45:59.621953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 523/1062] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:45:59.627435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.721288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f76c3d-98bc-4ea8-96c6-6cce690bd967 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.752364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.753016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.753299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.753571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.754348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:45:59.754663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.756110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bbc73-2185-45ef-b56a-009ecce237ff None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.773170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 540/1063] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:45:59.774365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:45:59.872598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fbb6-4bc9-479a-b3f8-8cbdefea8067 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:45:59.905112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:45:59.906059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:45:59.906345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:45:59.906626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/efd61b07dde3439da736cac9bd4c5f76` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:45:59.909177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=55ae9eb24d0a4617bb52c9680bc7a1d4, role_id=efd61b07dde3439da736cac9bd4c5f76)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:45:59.910720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f52a3-4746-4c6e-9963-d2165b0e72a4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:45:59.999505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 524/1064] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:45:59 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/55ae9eb24d0a4617bb52c9680bc7a1d4/roles/efd61b07dde3439da736cac9bd4c5f76 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:46:00.278875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e259-b86b-4846-905d-512a23dadb3f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.279066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e259-b86b-4846-905d-512a23dadb3f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.279345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2e259-b86b-4846-905d-512a23dadb3f None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.281337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09959d0-e0df-4d17-af59-76a8141f741f None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.281840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 541/1065] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:00.281921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09959d0-e0df-4d17-af59-76a8141f741f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.281921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09959d0-e0df-4d17-af59-76a8141f741f None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.283740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 525/1066] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:46:00.286314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.286606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.286886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.288665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.289074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.289358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.304245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:00.305435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:00.306236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:00.307444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:00.371840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 542/1067] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:00.380822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 526/1068] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:46:00.393234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.403231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.489952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7587c45-ce8d-4795-833f-12ad0e65939e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.500141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114188-9e98-4338-b0a8-2f73fa6ce5d0 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.522930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:00.523738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.524025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.524301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.532531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:00.533130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.533419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.533701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.533861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:00.540660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:00.541992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 543/1069] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:00.548171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.600836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:00.602314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:00.643402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7bd3-7936-4ace-aeaf-368b63960037 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.676597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:00.677269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.677549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.677833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.678582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:00.678890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:00.680308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:00.688364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 544/1070] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:00.694201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.709584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 527/1071] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 12:46:00.710762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.790267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cec7cd-bd53-4611-b9b1-df8aef0add90 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.805922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e308c2c-8ae9-4d39-a564-4fad92edca25 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.823908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:00.824822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.825108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.825383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] PATH_INFO: `/v3/users/896a4a1d58414a219ddf0a7b0ed66488` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.839184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:00.840647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] RBAC: Authorizing `identity:get_user(user_id=896a4a1d58414a219ddf0a7b0ed66488)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:00.840752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:00.840972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:00.841250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:00.842296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:00.849140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 545/1072] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/users/896a4a1d58414a219ddf0a7b0ed66488 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:00.850245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.851491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:00.853058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:00.873610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:46:00.878705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 528/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:00.881408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:00.963348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c3e94-de1d-47c1-a70c-f00c7228fcf1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.978564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082bf1-f303-4890-a742-8b2b1cc4881e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:00.999800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:01.000453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:01.000743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:01.001052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:01.014524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:01.015184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:01.015487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:01.015774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:01.016493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:01.016809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:01.018240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:01.039507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 529/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:01.080565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:01.082039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:01.184226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 546/1075] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:01.190364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:01.290609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca968-24ef-488a-a622-fca446f56e30 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:01.323723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:01.325139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:01.325421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:01.325696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:01.326871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:01.328341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10254e2-f702-4dbe-b14f-5d15ddeebd9b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:01.330336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 530/1076] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:01 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:01.336378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:01.429864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c5bd-8599-4ba2-83ac-1e253a6c13a2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:01.462113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:01.462754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:01.463037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:01.463313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:01.464182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=4506325c184e49a1bf4a88240c4d6a2d, user.id=896a4a1d58414a219ddf0a7b0ed66488) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:01.464489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:01.465939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1be0-d65c-464d-b855-a5c3c298a845 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:01.471043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 547/1077] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:01 2022] GET /identity/v3/role_assignments?user.id=896a4a1d58414a219ddf0a7b0ed66488&scope.project.id=4506325c184e49a1bf4a88240c4d6a2d&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:02.285654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a083b-e4fd-4495-9c1a-b9aa6ad91b55 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.285868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a083b-e4fd-4495-9c1a-b9aa6ad91b55 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.286150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a083b-e4fd-4495-9c1a-b9aa6ad91b55 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.288006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 531/1078] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:02.293967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.294327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.294668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.311259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:02.312460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:02.375389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 548/1079] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:02.398300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a083b-e4fd-4495-9c1a-b9aa6ad91b55 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:02.496888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a083b-e4fd-4495-9c1a-b9aa6ad91b55 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:02.529775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:02.530586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.530871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.531151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.541429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:02.548953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 12:46:02.550166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 532/1080] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Feb 28 12:46:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:02.556215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:02.653453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01deaa-7fc0-4fae-ac2c-267f8426984a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:02.686558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:02.687456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.687770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.688054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.688802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:02.689112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:02.690487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:02.703689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 549/1081] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:46:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:02.704884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:02.800020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91548526-8f88-4fc3-aa1a-2f06ac784996 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:02.832732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:02.833512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.846322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.846322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.846322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:02.846322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:02.862041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:46:02.863197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 533/1082] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:02.869018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:02.963265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad594c-155e-46d3-be97-487ae603d98f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:02.995001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:02.995692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:02.996009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:02.996288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:02.997007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:02.997313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:02.998679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:03.010052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 550/1083] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:03.015588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.108765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9271-7a87-4c22-95a9-7549cb9d214c None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:03.140817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:03.141598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.141880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.142154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.148876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:03.150306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:03.163446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 12:46:03.164641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 534/1084] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:03.170224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.262691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af132399-a9e9-413f-9e71-2ae105dbe760 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:03.293969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:03.294631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.294912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.295188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.296042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:03.296350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:03.297781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:03.314447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 551/1085] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:03.320243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.414917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063af89-7f97-4d25-91e9-d71b87610f0b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:03.449516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:03.450162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.450446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.450721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.513475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:03.514926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f588a-7bcf-45cf-bebe-6ff0d46d6064 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:03.607070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 535/1086] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:03.612731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.705437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988b72-3ecd-4eb8-ba66-72a39ff47c38 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:03.764899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204b2c-280c-42f6-aa1b-1656c397e191 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.765190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204b2c-280c-42f6-aa1b-1656c397e191 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.765472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2204b2c-280c-42f6-aa1b-1656c397e191 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.767305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 536/1087] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:46:03.773170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.773461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.773744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.791517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:03.792738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:03.860783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 537/1088] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:46:03.862264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:03.863053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:03.863340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:03.863647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:03.873409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:03.874865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:03.883415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.890986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:46:03.892332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 552/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:46:03.897743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:03.975772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77463df8-f9cd-4336-958b-432ebd3fd182 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:03.991692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925aac7-e690-41f3-a878-fa26a8e0c4b2 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.006964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.007781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.008063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.008335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.018335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:04.023306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.024047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.024334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.024610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.025077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:04.025319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:04.025624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.026252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 538/1090] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:46:04.026995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.032605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.038247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 553/1091] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:04.043542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.124245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6cb51-8342-4fe3-8e3b-8e3512087999 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.133576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5038d-d644-4d79-82bd-9162fffb7e33 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.156054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.156705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.156985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.157259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.157991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:04.158298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.159699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.165487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.166256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.166537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.166811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.167522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 539/1092] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:04.172896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.176967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.178388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.190897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:46:04.192072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 554/1093] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:46:04.197771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.266046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c6b6-d445-4996-a5af-04d27242a054 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.289070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db7a7-8cb4-433c-8490-d7583caf9547 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.297299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.298158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.298442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.298718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] PATH_INFO: `/v3/users/896a4a1d58414a219ddf0a7b0ed66488` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.299930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] RBAC: Authorizing `identity:get_user(user_id=896a4a1d58414a219ddf0a7b0ed66488)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.301375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.302982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 540/1094] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/users/896a4a1d58414a219ddf0a7b0ed66488 => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:04.308481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.320897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.321538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.321818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.322087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.322854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:04.323156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.325121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.336045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 555/1095] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:04.342185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.402001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a09b-8d52-460f-bba8-d207c1ace39d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.431307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad40d92-89a2-4a49-9a89-3a098e0f6055 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.432951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.434320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.434604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.434876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.436072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.437512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.439188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 541/1096] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:04.445066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:04.463266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.463943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.464225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.464504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.465337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] RBAC: Adding query filter params (role.id=efd61b07dde3439da736cac9bd4c5f76, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=55ae9eb24d0a4617bb52c9680bc7a1d4) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:04.465651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.467058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876b4c6-6ed1-4db1-ba12-5361bd2ef7fd None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.478891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 556/1097] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:04 2022] GET /identity/v3/role_assignments?user.id=55ae9eb24d0a4617bb52c9680bc7a1d4&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=efd61b07dde3439da736cac9bd4c5f76 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:04.542894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c4bf3-6c17-41e7-8a13-c94735a03e9f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:04.578108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:04.579008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:04.579291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:04.579598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d/users/896a4a1d58414a219ddf0a7b0ed66488/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:04.581618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=4506325c184e49a1bf4a88240c4d6a2d, user_id=896a4a1d58414a219ddf0a7b0ed66488, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:04.583099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0f9cf-1250-4cad-b63c-a80ec1116f06 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:04.666373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 542/1098] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:46:04 2022] PUT /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d/users/896a4a1d58414a219ddf0a7b0ed66488/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:46:06.936234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc4ab-1a0f-4652-bef4-2886b02b0796 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:06.936806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc4ab-1a0f-4652-bef4-2886b02b0796 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:06.936806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc4ab-1a0f-4652-bef4-2886b02b0796 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:06.938541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 557/1099] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:06.943739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:06.944435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:06.944538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:06.961391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:06.962548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:07.024843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 543/1100] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:07.048361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc4ab-1a0f-4652-bef4-2886b02b0796 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.141901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc4ab-1a0f-4652-bef4-2886b02b0796 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:07.172897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:07.173664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:07.173948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:07.174221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:07.184249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:07.191030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:07.192141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 558/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:07.198163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.288353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735861f-2361-43f5-80ee-cb65a30c6043 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:07.320238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92746301-eba2-4238-8446-52651b960b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:07.320881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746301-eba2-4238-8446-52651b960b93 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:07.321161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746301-eba2-4238-8446-52651b960b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:07.321434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746301-eba2-4238-8446-52651b960b93 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:07.322162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746301-eba2-4238-8446-52651b960b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:07.322465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746301-eba2-4238-8446-52651b960b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:07.323858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746301-eba2-4238-8446-52651b960b93 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:07.331344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 544/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:07.336752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.430729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f68f8-9e17-4ff5-b0d9-9a6fb214b9d3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:07.461431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:07.462257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:07.462574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:07.462795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] PATH_INFO: `/v3/users/896a4a1d58414a219ddf0a7b0ed66488` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:07.463995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] RBAC: Authorizing `identity:get_user(user_id=896a4a1d58414a219ddf0a7b0ed66488)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:07.465926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:07.467511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 559/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/users/896a4a1d58414a219ddf0a7b0ed66488 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:07.472990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92746301-eba2-4238-8446-52651b960b93 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.564290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92746301-eba2-4238-8446-52651b960b93 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:07.595294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:07.595952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:07.596234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:07.596505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:07.657656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:07.659076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:07.748919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 545/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:07.754435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.845706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acc996-bef2-47b1-a778-ae8efa7953ad None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:07.875631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:07.876459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:07.876738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:07.877006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:07.878151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:07.879591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6014d7-2877-4b65-8453-2e938d34b236 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:07.881203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 560/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:07.887631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:07.980437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70e06f-bdd1-449b-a738-255a78d5a2fe None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:08.012286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:08.012873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:08.013156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:08.013428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:08.014237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=4506325c184e49a1bf4a88240c4d6a2d, user.id=896a4a1d58414a219ddf0a7b0ed66488) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:08.014696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:08.016164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8137fe-9567-4e67-8787-4b5bfc844575 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:08.021647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 546/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:07 2022] GET /identity/v3/role_assignments?user.id=896a4a1d58414a219ddf0a7b0ed66488&scope.project.id=4506325c184e49a1bf4a88240c4d6a2d&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:10.307444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd01d6e-bd4e-4b4f-927d-64f6f42e6a40 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:10.307982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd01d6e-bd4e-4b4f-927d-64f6f42e6a40 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:10.307982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd01d6e-bd4e-4b4f-927d-64f6f42e6a40 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:10.309771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 561/1107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:10.314953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:10.315437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:10.315543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:10.332486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:10.333650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:10.395572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 547/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:10.419871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd01d6e-bd4e-4b4f-927d-64f6f42e6a40 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:10.519444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd01d6e-bd4e-4b4f-927d-64f6f42e6a40 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:10.550745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:10.551555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:10.551845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:10.552120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:10.553269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:10.554690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f1f6-2852-4e98-8321-dbb7b82d8107 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:10.556265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 562/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:10.562398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:10.656442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc866-b2aa-439a-8a74-71bb357f2ce9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:10.687738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:10.688388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:10.688669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:10.688944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:10.689685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:10.691126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b8ee1-79e5-4515-b847-fad74c415b80 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:10.775711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 548/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:46:10 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:46:13.074982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5453-b212-48b2-a79d-6c183dad71d8 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.075513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5453-b212-48b2-a79d-6c183dad71d8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.075606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5453-b212-48b2-a79d-6c183dad71d8 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.077312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 563/1111] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:13.082460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.082878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.083016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.099841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:13.101008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:13.161781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 549/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:13.184617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad5453-b212-48b2-a79d-6c183dad71d8 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:13.278559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad5453-b212-48b2-a79d-6c183dad71d8 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:13.309257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:13.310075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.310359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.310825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] PATH_INFO: `/v3/roles/6135515bbd37458794241e7a2844577e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.312313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] RBAC: Authorizing `identity:get_role(role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:13.313666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:13.314961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 564/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:13 2022] GET /identity/v3/roles/6135515bbd37458794241e7a2844577e => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:13.321339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:13.412642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ae435-238f-4fb1-b398-b2cf80d0171c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:13.444089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:13.444935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.445215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.445486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] PATH_INFO: `/v3/users/7b853e394fdb4d1a9674c0be3f0528f0` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.458331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] RBAC: Authorizing `identity:get_user(user_id=7b853e394fdb4d1a9674c0be3f0528f0)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:13.459828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:13.461467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 550/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:13 2022] GET /identity/v3/users/7b853e394fdb4d1a9674c0be3f0528f0 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:13.467121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:13.557413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cfaf-2623-4035-a51b-93957ae6d650 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:13.589200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:13.589849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.590133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.590410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.651579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:13.653031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:13.742295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 565/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:13.748510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:13.839654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d40c-33f8-491c-8469-3b304149f17f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:13.871303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:13.872158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:13.872441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:13.872712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:13.873857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:13.875282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a748db3-e7e7-4081-8bb0-46e6e3d16cd4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:13.876952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 551/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:13 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:13.882634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:13.973301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ac425-885d-4803-83e6-cf0c6ee0065e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:14.004900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:14.005533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:14.005811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:14.006080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:14.006885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=4506325c184e49a1bf4a88240c4d6a2d, user.id=7b853e394fdb4d1a9674c0be3f0528f0) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:14.007191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:14.008644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b78c83-058a-4269-81ec-ec493caff98d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:14.013733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 566/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:13 2022] GET /identity/v3/role_assignments?user.id=7b853e394fdb4d1a9674c0be3f0528f0&scope.project.id=4506325c184e49a1bf4a88240c4d6a2d&role.id=6135515bbd37458794241e7a2844577e => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:16.245297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929e58-1026-4e5e-b7bb-84242004d9ab None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.245816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929e58-1026-4e5e-b7bb-84242004d9ab None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.245816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929e58-1026-4e5e-b7bb-84242004d9ab None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.247563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 552/1118] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:16.252751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.253154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.253311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.269952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:16.271123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:16.332408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 567/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:16.355502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929e58-1026-4e5e-b7bb-84242004d9ab None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:16.450562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929e58-1026-4e5e-b7bb-84242004d9ab None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:16.481675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:16.482515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.482796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.483069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] PATH_INFO: `/v3/roles/6135515bbd37458794241e7a2844577e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.484495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] RBAC: Authorizing `identity:get_role(role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:16.485866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:16.487190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 553/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:16 2022] GET /identity/v3/roles/6135515bbd37458794241e7a2844577e => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:16.492790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:16.586107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e0b77-cd41-4d6d-90d5-4ae2b761a627 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:16.617186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:16.618030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.618316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.618594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] PATH_INFO: `/v3/users/7b853e394fdb4d1a9674c0be3f0528f0` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.619789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] RBAC: Authorizing `identity:get_user(user_id=7b853e394fdb4d1a9674c0be3f0528f0)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:16.621738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:16.623318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 568/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:16 2022] GET /identity/v3/users/7b853e394fdb4d1a9674c0be3f0528f0 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:16.628959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:16.721395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455477-8c3b-4b9e-b4b2-c03f69734ef9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:16.753717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:16.754556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.754837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.755109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.756283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:16.757714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3dd99-c4ca-4676-b903-ea012ece20b8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:16.759338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 554/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:16 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:16.765064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:16.856862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcd109-e6a6-4365-9b01-db93266235bb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:16.888132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:16.888988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:16.889276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:16.889556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d/users/7b853e394fdb4d1a9674c0be3f0528f0/roles/6135515bbd37458794241e7a2844577e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:16.891762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4506325c184e49a1bf4a88240c4d6a2d, user_id=7b853e394fdb4d1a9674c0be3f0528f0, role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:16.893180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25455dba-b3ba-46a1-acfd-9a6c985073f1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:16.956609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 569/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:46:16 2022] PUT /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d/users/7b853e394fdb4d1a9674c0be3f0528f0/roles/6135515bbd37458794241e7a2844577e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:46:19.212630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791a6c-9a10-43cd-b10b-d982af11f78d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.213137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791a6c-9a10-43cd-b10b-d982af11f78d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.213137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791a6c-9a10-43cd-b10b-d982af11f78d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:19.215456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 555/1124] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:19.220717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.221134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.221269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:19.237320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:19.238488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:19.299744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 570/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:19.323123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38791a6c-9a10-43cd-b10b-d982af11f78d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:19.416630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38791a6c-9a10-43cd-b10b-d982af11f78d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:19.447841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:19.449246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.449530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.449805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] PATH_INFO: `/v3/roles/6135515bbd37458794241e7a2844577e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:19.451235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] RBAC: Authorizing `identity:get_role(role_id=6135515bbd37458794241e7a2844577e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:19.452634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:19.453942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 556/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:19 2022] GET /identity/v3/roles/6135515bbd37458794241e7a2844577e => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:19.459362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:19.550096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e394953-045e-4735-8aed-45a586f42b77 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:19.581999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:19.582835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.583115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.583387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] PATH_INFO: `/v3/users/7b853e394fdb4d1a9674c0be3f0528f0` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:19.584583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] RBAC: Authorizing `identity:get_user(user_id=7b853e394fdb4d1a9674c0be3f0528f0)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:19.586023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:19.587621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 571/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:19 2022] GET /identity/v3/users/7b853e394fdb4d1a9674c0be3f0528f0 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:19.593364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:19.684874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341a3f-3660-4062-be11-b952570129ec None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:19.716354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:19.716993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.717257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.717529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:19.778478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:19.779936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:19.869668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 557/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:19.875787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:19.967612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42b799-18fd-449b-85d8-452bb280b9ec None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:19.998235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:19.999071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:19.999354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:19.999670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] PATH_INFO: `/v3/projects/4506325c184e49a1bf4a88240c4d6a2d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:20.000828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4506325c184e49a1bf4a88240c4d6a2d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:20.002248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6a38-31cd-4868-b2a8-86753d5150b5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:20.003929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 572/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:19 2022] GET /identity/v3/projects/4506325c184e49a1bf4a88240c4d6a2d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:20.009853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:20.101610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3643-b39e-4efb-bb9e-81122cff4df0 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:20.132776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:20.133352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:20.133631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:20.133902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:20.134708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] RBAC: Adding query filter params (role.id=6135515bbd37458794241e7a2844577e, scope.project.id=4506325c184e49a1bf4a88240c4d6a2d, user.id=7b853e394fdb4d1a9674c0be3f0528f0) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:20.135014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:20.137097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177893a-a591-4b43-8592-fc6a1beb1120 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:20.142534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 558/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:20 2022] GET /identity/v3/role_assignments?user.id=7b853e394fdb4d1a9674c0be3f0528f0&scope.project.id=4506325c184e49a1bf4a88240c4d6a2d&role.id=6135515bbd37458794241e7a2844577e => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:22.421160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61ace-e5d0-4d92-933e-f4666df182aa None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:22.421681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61ace-e5d0-4d92-933e-f4666df182aa None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:22.421794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d61ace-e5d0-4d92-933e-f4666df182aa None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:22.423481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 573/1131] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:22.428579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649820-4524-4199-909f-eadf332922f1 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:22.428979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649820-4524-4199-909f-eadf332922f1 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:22.429136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68649820-4524-4199-909f-eadf332922f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:22.445578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-68649820-4524-4199-909f-eadf332922f1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:22.446750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-68649820-4524-4199-909f-eadf332922f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:22.508259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 559/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:22.531561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d61ace-e5d0-4d92-933e-f4666df182aa None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:22.631777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d61ace-e5d0-4d92-933e-f4666df182aa None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:22.663020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:22.663854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:22.664146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:22.664420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:22.665583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:22.667014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b240-aee8-430a-9c41-178aef04a1a3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:22.669236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 574/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:22.675270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68649820-4524-4199-909f-eadf332922f1 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:22.768199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68649820-4524-4199-909f-eadf332922f1 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:22.799362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:22.800028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:22.800312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:22.800586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:22.801288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:22.802720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afc925-8ba4-4a27-97cb-f4f73f8cffde None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:22.913149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 560/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:46:22 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:46:25.201174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb205a-695c-4476-bba1-2ac8985e4801 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:25.201682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb205a-695c-4476-bba1-2ac8985e4801 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:25.201682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb205a-695c-4476-bba1-2ac8985e4801 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:25.203433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 575/1135] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:25.208718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:25.209093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:25.209280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:25.226329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:25.227524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:25.289397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 561/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 12:46:25.313545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb205a-695c-4476-bba1-2ac8985e4801 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:25.408391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb205a-695c-4476-bba1-2ac8985e4801 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:25.439321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:25.440117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:25.440399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:25.440672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:25.441826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:25.443243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6dc95-d9f4-4afc-bb19-ee175ab47df7 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:25.445075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 576/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:25.451080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:25.541275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8b0b-6d6f-4b1d-bea4-f8ea8cebba68 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:25.574112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:25.574744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:25.575026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:25.575301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:25.576036 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:25.577464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a512-effa-469a-8af0-9ec126c056a9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:25.676265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 562/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:46:25 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:46:27.991101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50c15-8877-4f58-abde-1c8168ffa01f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:27.991613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50c15-8877-4f58-abde-1c8168ffa01f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:27.991716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50c15-8877-4f58-abde-1c8168ffa01f None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:27.993440 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 577/1139] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:27.998733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:27.999150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:27.999293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.016100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:28.017268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:28.079419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 563/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:28.103031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50c15-8877-4f58-abde-1c8168ffa01f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:28.195809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50c15-8877-4f58-abde-1c8168ffa01f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:28.227390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:28.228182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:28.228468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:28.228743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.238145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:28.244980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:28.246134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 578/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:28.252012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:28.343450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9c9c-c70d-4fac-b751-b006bdfbd6e6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:28.374813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:28.375460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:28.375785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:28.376063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.376801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:28.377108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:28.378477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:28.386052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 564/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:28.391577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:28.484295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c87753-e041-4290-81b3-a1b679d7f82a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:28.514528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:28.515362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:28.515678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:28.515953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] PATH_INFO: `/v3/users/951ccfe4f0ea44279349cd2dd8a29c78` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.528534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] RBAC: Authorizing `identity:get_user(user_id=951ccfe4f0ea44279349cd2dd8a29c78)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:28.529954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:28.531549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 579/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/users/951ccfe4f0ea44279349cd2dd8a29c78 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:28.536924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:28.630221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cffae-67ad-47f6-9b87-4847227754a2 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:28.661306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:28.661931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:28.662215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:28.662494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.726128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:28.727622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:28.817471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 565/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:28.824056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:28.914207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7693b-cc23-4c3d-bd0a-025834c48b6e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:28.946575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:28.947407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:28.947720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:28.947998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] PATH_INFO: `/v3/projects/3caeefff4d0945f38b722a5ea12278e2` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:28.949194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] RBAC: Authorizing `identity:get_project(project_id=3caeefff4d0945f38b722a5ea12278e2)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:28.950618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15fad5-ae57-406b-9167-2be89119dd14 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:28.952306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 580/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/projects/3caeefff4d0945f38b722a5ea12278e2 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:28.958214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:29.050138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d085b57-d46f-45bd-a1e8-a50f1ed8c76f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:29.082565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:29.083151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:29.083435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:29.083740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:29.084550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=3caeefff4d0945f38b722a5ea12278e2, user.id=951ccfe4f0ea44279349cd2dd8a29c78) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:29.084862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:29.086287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4e3e-8e73-4a68-8dd8-8764abff0bc2 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:29.091462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 566/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:28 2022] GET /identity/v3/role_assignments?user.id=951ccfe4f0ea44279349cd2dd8a29c78&scope.project.id=3caeefff4d0945f38b722a5ea12278e2&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:31.331372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbecc-a04b-4d15-ba7c-cc93f372a654 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.331960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbecc-a04b-4d15-ba7c-cc93f372a654 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.332053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbecc-a04b-4d15-ba7c-cc93f372a654 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.333769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 581/1147] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:31.339462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.339875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.340041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.356941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:31.358122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:31.420522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 567/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:31.443532 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbecc-a04b-4d15-ba7c-cc93f372a654 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:31.536813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbecc-a04b-4d15-ba7c-cc93f372a654 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:31.567870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:31.568893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.569179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.569455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.578846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:31.585732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:31.586817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 582/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:31.593079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:31.684806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd5194-b6d7-4eda-a4f2-6c70c8052e81 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:31.716583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:31.717337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.717621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.717898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.718635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:31.718942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:31.720347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:31.727957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 568/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:31.733994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:31.826459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0aaec-6e62-4d83-84dc-63c3a996e2d3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:31.857153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:31.857930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.858213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.858488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] PATH_INFO: `/v3/users/951ccfe4f0ea44279349cd2dd8a29c78` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.859673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] RBAC: Authorizing `identity:get_user(user_id=951ccfe4f0ea44279349cd2dd8a29c78)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:31.861095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:31.862649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 583/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:31 2022] GET /identity/v3/users/951ccfe4f0ea44279349cd2dd8a29c78 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:31.868094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:31.961100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f58a8b-493b-4884-972f-1bec07d39851 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:31.992347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:31.993195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:31.993480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:31.993755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] PATH_INFO: `/v3/projects/3caeefff4d0945f38b722a5ea12278e2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:31.994916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] RBAC: Authorizing `identity:get_project(project_id=3caeefff4d0945f38b722a5ea12278e2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:31.996412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531727-4ebc-4646-8be9-99c36fe97c2d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:31.998071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 569/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:31 2022] GET /identity/v3/projects/3caeefff4d0945f38b722a5ea12278e2 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:46:32.003843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:32.096876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155083-8dd6-41a6-8bf4-88a4cb907e4e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:32.127736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:32.128552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:32.128835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:32.129112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] PATH_INFO: `/v3/projects/3caeefff4d0945f38b722a5ea12278e2/users/951ccfe4f0ea44279349cd2dd8a29c78/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:32.131028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=3caeefff4d0945f38b722a5ea12278e2, user_id=951ccfe4f0ea44279349cd2dd8a29c78, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:32.132470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db41e10-7bc4-44ac-9307-ac36f639dc14 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:32.220518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 584/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:46:32 2022] PUT /identity/v3/projects/3caeefff4d0945f38b722a5ea12278e2/users/951ccfe4f0ea44279349cd2dd8a29c78/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:46:34.499994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35d02-499d-4925-a87c-60883a9e1298 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:34.500537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35d02-499d-4925-a87c-60883a9e1298 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:34.500537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35d02-499d-4925-a87c-60883a9e1298 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:34.502342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 570/1154] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:34.507509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:34.507919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:34.508064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:34.524901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:34.526071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:34.587736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 585/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:34.611973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d35d02-499d-4925-a87c-60883a9e1298 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:34.708106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d35d02-499d-4925-a87c-60883a9e1298 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:34.739327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:34.740133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:34.740420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:34.740699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:34.750927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:34.757773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:34.758933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 571/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:34.765431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:34.856082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d1856-e99f-4f5d-a535-7cfbf55f3465 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:34.887534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:34.888180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:34.888470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:34.888741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:34.889474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:34.889779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:34.891147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:34.898698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 586/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:34.904802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:34.997866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae961d93-5d8e-4c82-beea-4864c4f3b314 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:35.029905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:35.030695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:35.030977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:35.031252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] PATH_INFO: `/v3/users/951ccfe4f0ea44279349cd2dd8a29c78` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:35.032431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] RBAC: Authorizing `identity:get_user(user_id=951ccfe4f0ea44279349cd2dd8a29c78)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:35.033875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:35.035455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 572/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:34 2022] GET /identity/v3/users/951ccfe4f0ea44279349cd2dd8a29c78 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:35.041038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:35.133557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310caf-9494-4af9-92f9-f519bc54b8e8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:35.164290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:35.164912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:35.165197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:35.165475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:35.227065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:35.228521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:35.317951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 587/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:35.323886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:35.415903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bd0bc-3b17-4411-9621-be956041ebf8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:35.447164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:35.448611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:35.448897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:35.449168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] PATH_INFO: `/v3/projects/3caeefff4d0945f38b722a5ea12278e2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:35.450311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] RBAC: Authorizing `identity:get_project(project_id=3caeefff4d0945f38b722a5ea12278e2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:35.451755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2749cd-b44b-41b8-afef-85de2084ff98 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:35.453446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 573/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:35 2022] GET /identity/v3/projects/3caeefff4d0945f38b722a5ea12278e2 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:35.459146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:35.550253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e44b4-b850-459c-bb73-550c6eec3022 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:35.581589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:35.582167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:35.582450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:35.582726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:35.583571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=3caeefff4d0945f38b722a5ea12278e2, user.id=951ccfe4f0ea44279349cd2dd8a29c78) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:35.583888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:35.585297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0fe37-c112-4bf6-aa8b-cd605d7475c4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:35.590759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 588/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:35 2022] GET /identity/v3/role_assignments?user.id=951ccfe4f0ea44279349cd2dd8a29c78&scope.project.id=3caeefff4d0945f38b722a5ea12278e2&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:37.873917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81a34-e5e8-42a6-bca4-8966fc39abee None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:37.874462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81a34-e5e8-42a6-bca4-8966fc39abee None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:37.874462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f81a34-e5e8-42a6-bca4-8966fc39abee None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:37.876171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 574/1162] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:37.881370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:37.881757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:37.881927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:37.898094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:37.899262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:37.961157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 589/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:37.984546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f81a34-e5e8-42a6-bca4-8966fc39abee None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:38.080484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f81a34-e5e8-42a6-bca4-8966fc39abee None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:38.112228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:38.112854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:38.113137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:38.113411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:38.174632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:38.176042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:38.265004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 575/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:38.270860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:38.361580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b7a1-875f-405a-b0ca-7143a63c5a62 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:38.392260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:38.393047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:38.393332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:38.393609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:38.400115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:38.402060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:38.414856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-5233afb8-0086-4b77-a3c0-deeacd811b17 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 12:46:38.416017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 590/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:46:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:38.422434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:38.513734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f365-d7b4-49c5-8112-869e93393c65 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:38.546028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:38.546655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:38.546934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:38.547205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:38.547939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:38.548242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:38.549603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a461e5-d1e0-42b8-a40a-ee9724da4ae8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:38.556323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 576/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Feb 28 12:46:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:40.813423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817a907-e2a0-445b-87a3-248d70042987 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:40.813975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817a907-e2a0-445b-87a3-248d70042987 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:40.813975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817a907-e2a0-445b-87a3-248d70042987 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:40.815774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 591/1167] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:40.821109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c4-cfb5-4b5a-a5c3-16599882120a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:40.821475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c4-cfb5-4b5a-a5c3-16599882120a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:40.821672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70819c4-cfb5-4b5a-a5c3-16599882120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:40.838340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b70819c4-cfb5-4b5a-a5c3-16599882120a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:40.840106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b70819c4-cfb5-4b5a-a5c3-16599882120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:40.901973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 577/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:40.924357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817a907-e2a0-445b-87a3-248d70042987 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:41.019209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817a907-e2a0-445b-87a3-248d70042987 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:41.050370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:41.051010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:41.051292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:41.051593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:41.052333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:41.053692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b8644-0216-421c-90a3-e05d82158750 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:41.159719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 592/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Feb 28 12:46:40 2022] POST /identity/v3/domains => generated 267 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:46:43.485397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40c5e-68e2-44d9-9e60-4bdc6d2dc063 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:43.485945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40c5e-68e2-44d9-9e60-4bdc6d2dc063 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:43.485945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40c5e-68e2-44d9-9e60-4bdc6d2dc063 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:43.487769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 578/1170] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:43.492970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:43.493394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:43.493538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:43.510293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:43.512081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:43.574015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 593/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:43.596701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40c5e-68e2-44d9-9e60-4bdc6d2dc063 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:43.690822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40c5e-68e2-44d9-9e60-4bdc6d2dc063 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:43.723673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:43.724520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:43.724805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:43.725082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] PATH_INFO: `/v3/domains/d653e72417054f348a4719a1787c85bb` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:43.735573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d653e72417054f348a4719a1787c85bb)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:43.736985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4411b45-608b-4d1b-8653-13f8f02e0e45 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:43.738593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 579/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Feb 28 12:46:43 2022] GET /identity/v3/domains/d653e72417054f348a4719a1787c85bb => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:43.744406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:43.836308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5a01-d86e-4a22-99b2-48584413dd63 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:43.868929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:43.869576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:43.870400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:43.870681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:43.871387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:43.872858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4417d6-8c47-4034-b984-4c5890e26190 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:43.998351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 594/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:46:43 2022] POST /identity/v3/projects => generated 361 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:46:46.287078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6385c2-406f-4fae-953e-ef3ba7b91110 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:46.287611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6385c2-406f-4fae-953e-ef3ba7b91110 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:46.287611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6385c2-406f-4fae-953e-ef3ba7b91110 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:46.289375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 580/1174] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:46.295065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:46.295534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:46.295659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:46.312530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:46.313709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:46.376335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 595/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:46.401402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6385c2-406f-4fae-953e-ef3ba7b91110 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:46.496595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6385c2-406f-4fae-953e-ef3ba7b91110 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:46.527771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:46.528611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:46.528896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:46.529173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] PATH_INFO: `/v3/domains/d653e72417054f348a4719a1787c85bb` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:46.530330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d653e72417054f348a4719a1787c85bb)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:46.531801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6e8dd-0a68-4716-a8f9-fc66873f50d5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:46.533368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 581/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Feb 28 12:46:46 2022] GET /identity/v3/domains/d653e72417054f348a4719a1787c85bb => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:46.538905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:46.630563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4baf45-1165-4244-9025-3104eecfb139 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:46.662012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:46.662688 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:46.662975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:46.663254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:46.663984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:46.665511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ffaa-e1a1-40a8-84b2-7dfcdedf9960 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:46.813629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 596/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:46:46 2022] POST /identity/v3/users => generated 311 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:46:49.128423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517966-4a23-4c6f-a192-befdbe41deb9 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.128954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517966-4a23-4c6f-a192-befdbe41deb9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.128954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517966-4a23-4c6f-a192-befdbe41deb9 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.130736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 582/1178] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:49.136609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.137021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.137160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.153884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:49.155046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:49.216136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 597/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:49.238949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517966-4a23-4c6f-a192-befdbe41deb9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:49.334309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517966-4a23-4c6f-a192-befdbe41deb9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:49.365449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:49.366220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.366506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.366783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.377241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:49.384027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:49.385208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 583/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:49.391728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:49.481895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4d51d-f1a5-41b3-a0d2-6355192e7c61 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:49.513522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:49.514169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.514454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.514728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.515465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:49.515799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:49.517161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:49.524763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 598/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:49.530052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:49.622338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203417-2309-4f61-a1de-9975990206c7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:49.653810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:49.654644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.654924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.655197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] PATH_INFO: `/v3/users/f42383cb07a9436dba3897c423cc9731` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.668427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] RBAC: Authorizing `identity:get_user(user_id=f42383cb07a9436dba3897c423cc9731)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:49.669870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:49.671459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 584/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:49 2022] GET /identity/v3/users/f42383cb07a9436dba3897c423cc9731 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:49.676908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:49.770845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3e7b8-7e4f-4fba-9746-0325dfbf45a8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:49.802081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:49.802713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:49.802999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:49.803277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:49.865018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:49.866451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:49.957896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 599/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:49.964257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:50.179172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61647d7f-cf4a-482f-83f8-b66f80572f0d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:50.211624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122faa38-3382-4730-a130-be94366fac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:50.212452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122faa38-3382-4730-a130-be94366fac6a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:50.212734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122faa38-3382-4730-a130-be94366fac6a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:50.213008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122faa38-3382-4730-a130-be94366fac6a None admin] PATH_INFO: `/v3/projects/3e4663e4db53438293865477f1ea0cc6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:50.214182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122faa38-3382-4730-a130-be94366fac6a None admin] RBAC: Authorizing `identity:get_project(project_id=3e4663e4db53438293865477f1ea0cc6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:50.215621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122faa38-3382-4730-a130-be94366fac6a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:50.217274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 585/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:49 2022] GET /identity/v3/projects/3e4663e4db53438293865477f1ea0cc6 => generated 361 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:50.223339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:50.313876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44d27-2c32-40c3-9e8d-4cf995f4ef07 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:50.345656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:50.346281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:50.346565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:50.346841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:50.347682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=3e4663e4db53438293865477f1ea0cc6, user.id=f42383cb07a9436dba3897c423cc9731) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:50.347994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:50.349412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a02eb-a637-4936-8957-f9a11eac97e8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:50.354518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 600/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:50 2022] GET /identity/v3/role_assignments?user.id=f42383cb07a9436dba3897c423cc9731&scope.project.id=3e4663e4db53438293865477f1ea0cc6&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:52.595508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a6217-67d4-42fd-8031-7f4f9efd38b5 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:52.596056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a6217-67d4-42fd-8031-7f4f9efd38b5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:52.596056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a6217-67d4-42fd-8031-7f4f9efd38b5 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:52.597813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 586/1186] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:52.603056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:52.603438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:52.603654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:52.620450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:52.621624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:52.682956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 601/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:52.706300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a6217-67d4-42fd-8031-7f4f9efd38b5 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:52.798572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a6217-67d4-42fd-8031-7f4f9efd38b5 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:52.830223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:52.830992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:52.831272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:52.831568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:52.841543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:52.848329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:52.849426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 587/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:52.855382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:52.946930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5b32-324b-42db-b07b-ccff569d13ee None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:52.978715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:52.979892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:52.980177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:52.980452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:52.981184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:52.981488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:52.982847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:52.990468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 602/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:52.996803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:53.088748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679231-aeb7-4702-aad7-4f18427abdd7 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:53.120205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:53.121014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:53.121301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:53.121577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] PATH_INFO: `/v3/users/f42383cb07a9436dba3897c423cc9731` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:53.122750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] RBAC: Authorizing `identity:get_user(user_id=f42383cb07a9436dba3897c423cc9731)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:53.124216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:53.125794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 588/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:52 2022] GET /identity/v3/users/f42383cb07a9436dba3897c423cc9731 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:53.131368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:53.223126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb441-9a0a-4f27-8904-f87d1028f915 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:53.254241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:53.255065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:53.255346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:53.255656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] PATH_INFO: `/v3/projects/3e4663e4db53438293865477f1ea0cc6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:53.256807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e4663e4db53438293865477f1ea0cc6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:53.258224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02e1ea-adfa-4ce4-acc6-740fae3bddf8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:53.259881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 603/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:53 2022] GET /identity/v3/projects/3e4663e4db53438293865477f1ea0cc6 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:53.265536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:53.357197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf56e-229c-46de-a6b5-e85ab4014c88 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:53.387938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:53.388746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:53.389027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:53.389300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] PATH_INFO: `/v3/projects/3e4663e4db53438293865477f1ea0cc6/users/f42383cb07a9436dba3897c423cc9731/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:53.391215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] RBAC: Authorizing `identity:create_grant(project_id=3e4663e4db53438293865477f1ea0cc6, user_id=f42383cb07a9436dba3897c423cc9731, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:53.392676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050379-1f6a-4d92-b6c2-134b2419492c None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:53.476853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 589/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:46:53 2022] PUT /identity/v3/projects/3e4663e4db53438293865477f1ea0cc6/users/f42383cb07a9436dba3897c423cc9731/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:46:55.716089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340164-b041-4ecf-98ea-44d5af14910b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:55.716637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340164-b041-4ecf-98ea-44d5af14910b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:55.716637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340164-b041-4ecf-98ea-44d5af14910b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:55.718394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 604/1193] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:46:55.723635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:55.724049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:55.724196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:55.740905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:46:55.742105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:46:55.804755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 590/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:46:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:46:55.828506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e340164-b041-4ecf-98ea-44d5af14910b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:55.922745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e340164-b041-4ecf-98ea-44d5af14910b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:55.955989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:55.956770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:55.957055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:55.957332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:55.966819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:46:55.973572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:46:55.974727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 605/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:46:55.981274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:56.074241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a699ca4-5783-4a5b-9444-fa866118c681 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:56.105698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:56.106349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:56.106633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:56.106908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:56.107668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:56.107976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:56.109346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:56.116874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 591/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:56.123003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:56.215186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbda-ca6d-46a1-8ec1-0d598313faab None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:56.246076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:56.246864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:56.247145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:56.247422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] PATH_INFO: `/v3/users/f42383cb07a9436dba3897c423cc9731` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:56.248635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] RBAC: Authorizing `identity:get_user(user_id=f42383cb07a9436dba3897c423cc9731)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:56.250062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:56.251658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 606/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Feb 28 12:46:56 2022] GET /identity/v3/users/f42383cb07a9436dba3897c423cc9731 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:56.257043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:56.349323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf749ca-9a64-4784-b417-f06aac3582e3 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:56.380008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:56.380625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:56.380909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:56.381183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:56.442027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:56.443729 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:56.533411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 592/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:46:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:46:56.538827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:56.629233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b7ea3-ff2c-4880-a5ea-0c5c8868270d None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:56.660393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:56.661208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:56.661487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:56.661756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] PATH_INFO: `/v3/projects/3e4663e4db53438293865477f1ea0cc6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:56.662897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] RBAC: Authorizing `identity:get_project(project_id=3e4663e4db53438293865477f1ea0cc6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:56.664406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15566631-441d-421a-9a1e-6b6719930bff None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:56.666018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 607/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Feb 28 12:46:56 2022] GET /identity/v3/projects/3e4663e4db53438293865477f1ea0cc6 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:46:56.671677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:46:56.763786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337becd-733f-4ab6-b5a0-5f2b7bb5f152 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:46:56.795971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:46:56.796559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:46:56.796841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:46:56.797115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:46:56.798018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=3e4663e4db53438293865477f1ea0cc6, user.id=f42383cb07a9436dba3897c423cc9731) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:46:56.798325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:46:56.799866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1fbde-fd64-4399-bddb-5a74efcc2eb1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:46:56.805455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 593/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:46:56 2022] GET /identity/v3/role_assignments?user.id=f42383cb07a9436dba3897c423cc9731&scope.project.id=3e4663e4db53438293865477f1ea0cc6&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:13.972314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aac3d-f000-4b8c-bd68-db07aad80f26 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:13.972837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aac3d-f000-4b8c-bd68-db07aad80f26 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:13.972938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aac3d-f000-4b8c-bd68-db07aad80f26 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:13.974687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 608/1201] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:13.979789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:13.980229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:13.980329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:13.996837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:13.998018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:14.060187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 594/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:14.086557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aac3d-f000-4b8c-bd68-db07aad80f26 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:14.182184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aac3d-f000-4b8c-bd68-db07aad80f26 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:14.213619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:14.214340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:14.214625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:14.214899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:14.225123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:14.226600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:14.243552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:14.244751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 609/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:14.250670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:14.344921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea6c8-a219-4988-8078-6b4a805810e8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:14.377424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:14.378080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:14.378365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:14.378640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:14.379354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:14.379687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:14.381071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd1f6-4848-40da-85d4-13ef0cda071f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:14.392414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 595/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:14.397951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:14.491171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248844-e912-4077-a10a-15e95310dcf4 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:14.522732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:14.523380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:14.523706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:14.523986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:14.524696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:14.526128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076987a-46ab-45bf-8243-e8adacab0402 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:14.630445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 610/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Feb 28 12:48:14 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 12:48:16.913750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379bb-ee05-409b-b0ca-add3906be2a2 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:16.914300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379bb-ee05-409b-b0ca-add3906be2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:16.914300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366379bb-ee05-409b-b0ca-add3906be2a2 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:16.916096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 596/1206] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:16.921152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:16.921567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:16.921758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:16.938663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:16.939863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:17.004191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 611/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:17.028040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366379bb-ee05-409b-b0ca-add3906be2a2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.126359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366379bb-ee05-409b-b0ca-add3906be2a2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.157843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.158629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.158910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.159184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.169469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:17.176618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:48:17.177784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 597/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:17.183901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.278406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9ca52-c2df-44fb-999e-74110b77acd6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.310547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.311203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.311507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.311788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.313224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:17.313529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:17.314909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:17.322761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 612/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:17.328988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.422576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b03-5ca3-4c98-bd15-e5ce996e2336 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.454940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.455780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.456075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.456329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.465992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:17.467527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:17.484301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:17.485457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 598/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:17.491129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.584711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654fa5-91b6-418f-b8e4-cd5fdc36a112 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.616138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.616787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.617074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.617349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.618061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:17.618368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:17.620394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:17.632339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 613/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:17.637871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.732615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6432c1-1fd2-45d6-9b1c-a3308377e4fa None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.764516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.765361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.765670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.765948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.773136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:17.774589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:17.788403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:17.789555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 599/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:17.795367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:17.890131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc6c57-12ad-4485-9010-948f1c0c6972 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:17.923405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:17.924103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:17.924383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:17.924655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:17.925471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:17.925778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:17.927192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:17.944618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 614/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:17.950293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.045224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076f4cf-cb65-439a-a830-835b7b2db9c5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.078376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.079016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.079306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.079614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.143268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.144735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.236983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 600/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:48:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:48:18.242818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.334636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0831ff-5119-46dc-8f00-df17e4795165 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.366337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.367113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.367403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.367704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.378038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.379497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.395495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:18.396656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 615/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:18.402563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.497339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67688fb-53d0-4c52-86d8-c17a1775ea12 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.529250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.529924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.530299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.530581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.531836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:18.532142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.533520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.544179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 601/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:18.550445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.645426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aabf13-f34a-4157-91d5-f92c91b2494f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.678310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.679083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.679426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.679735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.686165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.687760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.700561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:18.701698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 616/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:18.707753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.802196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9218-93d5-4799-acbb-666d4886e1a6 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.833982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.834630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.834918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.835198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.836002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:18.836313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.841644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf88ad-21ac-4851-8170-54e796b1902d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.849916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 602/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:18.856036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:18.950102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc0444-9fcc-48ca-b63d-683c5825b05a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:18.981421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:18.982072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:18.982409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:18.982639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:18.983462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=a0f16bdb11e5491aaadf0946b50a1e30) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:18.983806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:18.985739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e1bf-169d-4074-a423-8531ea743cd0 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:18.990969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 617/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:48:18 2022] GET /identity/v3/role_assignments?user.id=a0f16bdb11e5491aaadf0946b50a1e30&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:21.221568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1453-ef5e-45b7-a617-a87745d9fa20 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.222081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1453-ef5e-45b7-a617-a87745d9fa20 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.222178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1453-ef5e-45b7-a617-a87745d9fa20 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.224007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 603/1220] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:21.229224 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.229666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.229786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.246640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:21.247848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:21.310395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 618/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:21.333808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1453-ef5e-45b7-a617-a87745d9fa20 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:21.430766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1453-ef5e-45b7-a617-a87745d9fa20 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:21.464247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:21.465047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.465333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.465610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.475674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:21.482724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:48:21.483986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 604/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:48:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:21.490109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:21.583890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e8d6-b4de-437a-8b38-032976f5786c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:21.616004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:21.618731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.618731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.618731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.618731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] RBAC: Adding query filter params (name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:21.618731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:21.619590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:21.626977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 619/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:48:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:21.632766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:21.728294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dcdc-ea80-4de9-8a63-622a93a44950 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:21.760056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:21.765280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.765280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.765280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.772887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:21.774327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:21.790506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:21.791662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 605/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:21.797332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:21.892593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec89d-d561-478f-a218-e60f6d06b7af None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:21.924174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:21.924828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:21.925118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:21.925498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:21.926153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:21.926462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:21.927863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:21.939263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 620/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:21.945149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.039569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e9a74-ee19-4957-97e1-2378df2f8a40 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.070531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.071311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.071633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.071906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.079522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.080955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.093861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:22.095669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 606/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:22.101387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.195837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb88cd-e07f-4d9a-a85c-324170ed2b98 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.228587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.229239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.229779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.229779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.230587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:22.230894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.232504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.248700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 621/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:22.254815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.348475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149895d8-7df3-422c-b5c0-38c7bf756515 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.379816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.380592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.380874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.381147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.391101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.393189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.409041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:22.410195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 607/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:22.416005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.509285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c42ce-2db3-440a-8ae1-d300ed110f71 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.540803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.541452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.543233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.543233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.543233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:22.543233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.544463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.555879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 622/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:22.561566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.656264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcf1b-93d9-446d-a4f7-5710b59949e8 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.688910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.689686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.689975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.690246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.696939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.698378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.711196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:22.712387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 608/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:22.718166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.813954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ded23d-fbb2-4bc3-b182-5e0fa6481dec None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.846955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.847640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.847930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.848210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:22.848984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:22.849296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:22.850750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05d871-361a-4b46-88ec-f3acd82da556 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:22.863028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 623/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:22.868954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:22.964059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd677-3ade-4776-9f1f-f60c61d994b5 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:22.996028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:22.996902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:22.997179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:22.997450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/a0f16bdb11e5491aaadf0946b50a1e30/roles/055bf302608744c4b23c1537ea36473a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:23.012417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=a0f16bdb11e5491aaadf0946b50a1e30, role_id=055bf302608744c4b23c1537ea36473a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:23.013864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471120-1085-4760-813a-b02d2ad0c59f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:23.086580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 609/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:48:22 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/a0f16bdb11e5491aaadf0946b50a1e30/roles/055bf302608744c4b23c1537ea36473a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:48:25.331765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a81-187f-48de-88d1-a8c0eecca39e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:25.332334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a81-187f-48de-88d1-a8c0eecca39e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:25.332334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a81-187f-48de-88d1-a8c0eecca39e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:25.334110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 624/1233] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:25.339379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:25.339810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:25.339959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:25.356395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:25.357549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:25.419653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 610/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:25.443377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c9a81-187f-48de-88d1-a8c0eecca39e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:25.537712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c9a81-187f-48de-88d1-a8c0eecca39e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:25.569094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:25.569875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:25.570212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:25.570495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:25.580529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:25.587494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 12:48:25.588603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 625/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Feb 28 12:48:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:25.594870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:25.688311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809508a-caf5-4c53-962b-7641c32a9325 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:25.720378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:25.721034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:25.721336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:25.721611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:25.722340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] RBAC: Adding query filter params (name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:25.722643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:25.724068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:25.732022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 611/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Feb 28 12:48:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:48:25.737600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:25.831658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693a19-e43c-4c09-aa0e-66dabf9e739f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:25.863752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:25.864466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:25.864747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:25.865016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:25.875358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:25.877337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:25.893492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:25.894646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 626/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:25.900406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:25.993430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1dc9b-bfd3-44f8-9531-db55e2d0b68d None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.026919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.027607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.027950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.028233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.028940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:26.029245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.030619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.041341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 612/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:26.047081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:26.141932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd09f8-d483-4c87-8633-d87f97b7986e None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.174911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.175724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.176005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.176344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.183416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.184946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.198292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:26.199610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 627/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:26.205573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:26.301727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300883e4-24e2-47b7-a140-8ef37b194be9 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.334888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.335575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.335857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.336134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.336953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:26.337269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.338705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.355704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 613/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:26.361533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:26.455426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e64bd8-1f77-466c-978c-3b6eee5c6af5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.486992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.487645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.487930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.488207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.550676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.552159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.644153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 628/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:48:26.650122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:26.743108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014694-f06d-4710-b01e-1a6fab169f5e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.775718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.776497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.776787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.777067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.786535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.788021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.804801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:26.805942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 614/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:26.811896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:26.904226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10851e-f69d-4866-9500-5d198ba2717a None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:26.935559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:26.936201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:26.936492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:26.936774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:26.937495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:26.937807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:26.939699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:26.951221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 629/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:26.957559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:27.051686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950c0c-fe8d-4a4b-9028-a2e894e74d93 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:27.083964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:27.084750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:27.085094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:27.085368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:27.091852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:27.093302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:27.105803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:27.106952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 615/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:27.113528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:27.207791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05715-02bd-478b-9754-1dce438beb09 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:27.238895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:27.239559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:27.239846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:27.240122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:27.240894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:27.241202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:27.242628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c9d8b-108b-476b-a895-9ea1235c6768 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:27.255033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 630/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:27.261132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:27.356471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbd24-d4f8-4a99-918a-c57d17eecdd1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:27.388933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:27.389568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:27.389850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:27.390123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:27.390927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] RBAC: Adding query filter params (role.id=055bf302608744c4b23c1537ea36473a, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=a0f16bdb11e5491aaadf0946b50a1e30) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:27.391889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:27.393514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7446-3d96-445d-8a3e-c628d40fff46 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:27.399112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 616/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:48:27 2022] GET /identity/v3/role_assignments?user.id=a0f16bdb11e5491aaadf0946b50a1e30&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=055bf302608744c4b23c1537ea36473a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:29.718059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79cdb-804d-41bb-993f-8cd802d847bd None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:29.718581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79cdb-804d-41bb-993f-8cd802d847bd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:29.718672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef79cdb-804d-41bb-993f-8cd802d847bd None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:29.721072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 631/1247] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:29.726228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:29.726699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:29.726806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:29.743611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:29.744777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:29.807992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 617/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:29.831496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef79cdb-804d-41bb-993f-8cd802d847bd None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:29.926108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef79cdb-804d-41bb-993f-8cd802d847bd None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:29.957504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:29.958312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:29.958593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:29.958862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:29.972261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:29.975725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:48:29.977056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 632/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:29.982956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.078244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36acb9-3b34-41f3-b99e-1fe2573f48aa None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.110703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.111362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.111718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.112003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.112744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:30.113055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.114443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:30.122059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 618/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 12:48:30.127726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.224391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f787f-17fb-4147-bb94-a3071f9274e9 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.255489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.256310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.256590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.256863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.267309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.268764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:30.284837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:30.286103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 633/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:30.291904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.385643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81739c4-70d0-421e-aa96-a43bef281103 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.417766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.418421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.418709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.418993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.419753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:30.420105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.425775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:30.433113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 619/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:30.439450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.533521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016bf13-d632-4628-8ae0-e42c94748ed8 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.566397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.567184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.567498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.567778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.575107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.576578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:30.590266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:30.591417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 634/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:30.597262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.691650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75e76-5821-42e0-8bd3-69a5ef2f7017 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.723747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.724401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.724681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.724954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.725771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:30.726080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.727535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:30.744372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 620/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:30.750156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:30.843290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3210-398d-417b-9516-9b36a6e94686 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:30.874926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:30.876192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:30.876512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:30.876786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:30.939783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:30.941498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.034190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 635/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:48:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:48:31.039900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:31.134468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbb48e-543c-4338-aec6-9a74a9685a67 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:31.169509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:31.170288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:31.170601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:31.170873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:31.180954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:31.182449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.198510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:31.199670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 621/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:31.205405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:31.298194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99557f-7ebe-476f-a137-00a7264d0df5 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:31.329594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:31.330232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:31.330519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:31.330819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:31.331531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:31.331841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:31.333211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.343786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 636/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:31.349945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:31.444882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856613a-1e11-4cda-8c40-baddadca6213 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:31.477117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:31.477940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:31.478224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:31.478504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:31.485527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:31.486974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.499691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:31.500890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 622/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:31.512076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:31.600483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd21fe-2457-4632-869e-76d629054635 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:31.632209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:31.632848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:31.633132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:31.633410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:31.634178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:31.634487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:31.635938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c670c2-f20d-4d2b-a7ff-11437d0793b4 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.647208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 637/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:31.653135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:31.749224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcccbb-d3d8-46ed-bc31-536107173f9a None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:31.781005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:31.781646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:31.782483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:31.782765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:31.783608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=a0f16bdb11e5491aaadf0946b50a1e30) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:31.783921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:31.785358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231a071-9e71-4b08-9a47-bfe3c6a8f131 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:31.790608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 623/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:48:31 2022] GET /identity/v3/role_assignments?user.id=a0f16bdb11e5491aaadf0946b50a1e30&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:34.021339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc605a-ce8b-46a0-86cd-534884769fde None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.021872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc605a-ce8b-46a0-86cd-534884769fde None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.021981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc605a-ce8b-46a0-86cd-534884769fde None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.023766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 638/1261] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:48:34.028986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.029390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.029539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.046351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:34.049470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:34.109491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 624/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:34.132855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc605a-ce8b-46a0-86cd-534884769fde None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.228861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc605a-ce8b-46a0-86cd-534884769fde None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:34.260185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:34.260955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.261241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.261525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.271898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:34.278751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:48:34.279953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 639/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:34.285900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.379599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ad739-8f54-454c-8f9f-a9131fbb391c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:34.411937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:34.412586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.412869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.413144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.413877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:34.414186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:34.415580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:34.423702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 625/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:34.429397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.525486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d239-4491-4f4c-826e-d6c6b8201418 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:34.557108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:34.557902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.558182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.558455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.568675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:34.570113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:34.586059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:34.587198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 640/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:48:34.593050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.689537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1aadf-3362-420c-b36a-241fdfb46cb4 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:34.721245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:34.721894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.722178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.722458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.723164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:34.723542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:34.724866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:34.736612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 626/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:34.742140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.839004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc93a-e378-4170-9ad7-d1017f5e2810 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:34.872307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:34.873168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:34.873456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:34.873739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:34.880807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:34.882269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:34.895306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:34.896474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 641/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:34.902273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:34.998340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9bb10-c479-4a06-a823-d1fa3c76153f None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.030620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.031273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.031581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.031880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.032694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:35.032999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.034439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.050304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 627/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:35.055985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:35.152374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dbe60-5ff1-4e90-82dd-56d1638b208f None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.184142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.184978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.185265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.185544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.196684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.198140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.214314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:35.215485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 642/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:35.221210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:35.314239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc958-5b93-4083-aac9-0eb55402b217 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.346786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.347436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.347749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.348087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.348862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:35.349197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.350600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.361433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 628/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:35.367082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:35.462849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333aa60-e24e-4829-90f5-41a100003195 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.494653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.495429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.495744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.496024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.502672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.504160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.517944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:35.519236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 643/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:35.525007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:35.619340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f76c-441d-4c7e-bdf5-8e14307bd5ad None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.651201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.651878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.652162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.652438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.653208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:35.653515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.654941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7f0df-d95d-4d46-8aa3-86bdd50130ed None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.667056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 629/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:35.673109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:35.765772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c9bd-72d5-4674-aa49-cc0cb2430800 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:35.796885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:35.797778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:35.798059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:35.798332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] PATH_INFO: `/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/a0f16bdb11e5491aaadf0946b50a1e30/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:35.800306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] RBAC: Authorizing `identity:create_grant(project_id=d359df6fe00648978fe21b0dce4ecfe8, user_id=a0f16bdb11e5491aaadf0946b50a1e30, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:35.801716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b18c1-32b3-4aa1-9807-87ed008dff76 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:35.891858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 644/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Feb 28 12:48:35 2022] PUT /identity/v3/projects/d359df6fe00648978fe21b0dce4ecfe8/users/a0f16bdb11e5491aaadf0946b50a1e30/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:48:38.177388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067445e-7773-415d-a2bc-df630e51b15e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.177903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067445e-7773-415d-a2bc-df630e51b15e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.177989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067445e-7773-415d-a2bc-df630e51b15e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.179787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 630/1274] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:48:38.185090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda503-cc14-4809-818f-24505d819200 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.185487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda503-cc14-4809-818f-24505d819200 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.185658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda503-cc14-4809-818f-24505d819200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.202404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1fbda503-cc14-4809-818f-24505d819200 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:38.203578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1fbda503-cc14-4809-818f-24505d819200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:38.267386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 645/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:38.292496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067445e-7773-415d-a2bc-df630e51b15e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:38.388340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067445e-7773-415d-a2bc-df630e51b15e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:38.420257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:38.421028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.421306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.421577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.431619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 12:48:38.438993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 12:48:38.441423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 631/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Feb 28 12:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:38.446780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda503-cc14-4809-818f-24505d819200 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:38.538007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda503-cc14-4809-818f-24505d819200 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:38.570599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:38.571246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.571556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.571834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.572563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:38.572866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:38.574226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:38.581930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 646/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Feb 28 12:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:38.587716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:38.682875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93ba62-43ad-4292-a21b-9f6c198ca4be None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:38.714512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:38.715293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.715609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.715886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.726646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:38.728134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:38.744447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:38.745724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 632/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:48:38.751770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:38.847036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe2d85-4d25-4181-9898-cccfa77d80bc None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:38.879618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:38.880275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:38.880557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:38.880830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:38.881679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:38.881988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:38.883416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:38.895395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 647/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:38.901252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:38.997641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d76ff-8f75-473b-bb1f-b9d6229ffe11 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.033096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.033922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.034205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.034482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] PATH_INFO: `/v3/users/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.043144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.044689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:39.059758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 12:48:39.061042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 633/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:39.067973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:39.180078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024dae-0bea-4ff6-a909-968a53621ca3 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.210026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.210793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.211082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.211360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.212235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:39.212552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.214007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:39.233293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 648/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Feb 28 12:48:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:39.239773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:39.343283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e0b5-c9a6-459c-b1cb-748829242bed None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.378754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.379385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.379695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.379969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.445659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.447070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:39.542517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 634/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Feb 28 12:48:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 12:48:39.548423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:39.642283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3b0c1-bab3-4149-93af-a07c985e5fa1 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.675108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.675917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.676206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.676547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.686160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.688003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:39.704490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 12:48:39.705586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 649/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:39.711303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:39.804179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc793b21-f4c1-4ea7-8571-2654ec153cf1 None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.836974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.837624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.838001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.838283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.839003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:39.839312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.840720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:39.852236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 635/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Feb 28 12:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:39.857856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:39.954282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891e4f-dd44-42ef-91b9-e2c7a7cb3a1c None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:39.986479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:39.987204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:39.987508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:39.987947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:39.994432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:39.996016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:40.008801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING keystone.server.flask.application [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 12:48:40.009957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 650/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Feb 28 12:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:40.015858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:40.111006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150037-2662-4875-8e05-b160e9c3040b None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:40.141693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:40.142338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:40.142623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:40.142901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:40.143698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:40.144008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:40.145436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee66bf-6e40-495c-aa2e-9d6a9a20a732 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:40.157418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 636/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Feb 28 12:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:40.163325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:40.257214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecbfdb-88a2-421a-9fb2-530ffaec36eb None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:40.288617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:40.289314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:40.289603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:40.289879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:40.290689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] RBAC: Adding query filter params (role.id=02948fe3aa224688a909554882ca78f6, scope.project.id=d359df6fe00648978fe21b0dce4ecfe8, user.id=a0f16bdb11e5491aaadf0946b50a1e30) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:40.291001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:40.292454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978e28a-b552-4803-a87d-6e173da06677 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:40.298583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 651/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Feb 28 12:48:40 2022] GET /identity/v3/role_assignments?user.id=a0f16bdb11e5491aaadf0946b50a1e30&scope.project.id=d359df6fe00648978fe21b0dce4ecfe8&role.id=02948fe3aa224688a909554882ca78f6 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:42.600290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c679f9-b670-4006-9a3c-fa46d768daf3 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:42.600838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c679f9-b670-4006-9a3c-fa46d768daf3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:42.600838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c679f9-b670-4006-9a3c-fa46d768daf3 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:42.602630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 637/1288] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:42.607916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:42.608293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:42.608483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:42.625353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:42.626794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:42.688983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 652/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:42.711179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c679f9-b670-4006-9a3c-fa46d768daf3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:42.807238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c679f9-b670-4006-9a3c-fa46d768daf3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:42.839651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:42.840427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:42.840710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:42.840985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] PATH_INFO: `/v3/services/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:42.841628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:42.842993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:42.854220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 12:48:42.855287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 638/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:48:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:42.861250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:42.954196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1e63-7404-44d9-9b43-71ab5a0db9d8 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:42.986009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:42.987650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:42.987650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:42.987650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:42.987954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] RBAC: Adding query filter params (name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:42.988263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:42.989638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409867c4-1fbb-4eb3-857e-e3aaf4ff112f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:42.994409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 653/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Feb 28 12:48:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:43.000247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:43.093387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24152af-c2bd-40bc-92d0-f4a3c66834de None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:43.124620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:43.125206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:43.126016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:43.126324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] PATH_INFO: `/v3/services` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:43.127015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] RBAC: Adding query filter params (type=placement) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:43.127317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:43.128710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5c84c-a3a6-48c1-ba05-3036fc4bfa5b None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:43.132918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 639/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Feb 28 12:48:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:45.383741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513715-33dc-4002-b4e6-c9e4fcd31414 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:45.384292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513715-33dc-4002-b4e6-c9e4fcd31414 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:45.384292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513715-33dc-4002-b4e6-c9e4fcd31414 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:45.386072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 654/1293] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:45.391381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a74a7-7ee8-4d32-bd0e-29fe0096bdb0 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:45.391826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a74a7-7ee8-4d32-bd0e-29fe0096bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:45.392004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a74a7-7ee8-4d32-bd0e-29fe0096bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:45.408927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0d1a74a7-7ee8-4d32-bd0e-29fe0096bdb0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:45.410104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0d1a74a7-7ee8-4d32-bd0e-29fe0096bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:45.474643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 640/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:45.498079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e513715-33dc-4002-b4e6-c9e4fcd31414 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:45.592917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e513715-33dc-4002-b4e6-c9e4fcd31414 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:45.625702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:45.626347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:45.626635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:45.626913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:45.627745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:45.629154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500365-4ceb-4c24-badd-ccd8da61e690 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:45.721279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 655/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Feb 28 12:48:45 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:48:47.996487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0cea-16a7-4d14-bb58-513968f1ead5 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:47.996996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0cea-16a7-4d14-bb58-513968f1ead5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:47.997089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade0cea-16a7-4d14-bb58-513968f1ead5 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:47.998814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 641/1296] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:48.004593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:48.005060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:48.005202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:48.021657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:48.022862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:48.089891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 656/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:48.112675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0cea-16a7-4d14-bb58-513968f1ead5 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:48.207973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade0cea-16a7-4d14-bb58-513968f1ead5 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:48.239541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:48.240310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:48.240586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:48.240873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:48.241500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:48.242862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:48.254073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 12:48:48.255303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 642/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:48:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 12:48:48.261250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:48.357647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202cf48-ec58-4a29-9548-16a82c63f1bd None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:48.389728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:48.390478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:48.390766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:48.391625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:48.392327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:48.392638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:48.394054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:48.398951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 657/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Feb 28 12:48:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:48.404898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:48.498756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb10d2-3331-469f-9716-b8ac1d0bb07e None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:48.530927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:48.531625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:48.531915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:48.532192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:48.532971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] RBAC: Adding query filter params (interface=public, service_id=332fb1952ff345d594e5769abe171daa, region_id=RegionOne) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:48.533285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:48.534662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb914ca-19ce-400c-8803-790e078cdfb9 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:48.539409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 643/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Feb 28 12:48:48 2022] GET /identity/v3/endpoints?service_id=332fb1952ff345d594e5769abe171daa&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:48.544934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:48.637685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6649-7282-4973-ac47-5fa00077f294 None admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:48.668911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:48.669549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:48.669829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:48.670101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:48.670765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:48.672143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa79ef6-8fac-48aa-ad33-34b6fb13959f None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:48.679181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 658/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Feb 28 12:48:48 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:48:50.945737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e303d0-199d-4ffc-b063-fd99653be04f None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:50.993532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e303d0-199d-4ffc-b063-fd99653be04f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:50.993532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e303d0-199d-4ffc-b063-fd99653be04f None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:50.993532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 644/1302] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:48:50.993852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:50.993852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:50.993852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:50.993852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:48:50.993852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:48:51.036745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 659/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:48:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 12:48:51.060762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e303d0-199d-4ffc-b063-fd99653be04f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:51.157780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e303d0-199d-4ffc-b063-fd99653be04f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:51.189934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:51.191018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:51.191303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:51.191612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] PATH_INFO: `/v3/services/placement` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:51.192261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:51.193756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:51.204592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING keystone.server.flask.application [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 12:48:51.205716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 645/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Feb 28 12:48:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 12:48:51.211912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:51.305654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e390f6-7dec-4e77-ab39-ab9ed7d1bf85 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:51.337618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:51.338339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:51.338624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:51.338900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] PATH_INFO: `/v3/services` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:51.339622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] RBAC: Adding query filter params (name=placement) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:48:51.339927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:51.341286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ee65b-74d4-4153-b259-820995e3141a None admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:51.346765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 660/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Feb 28 12:48:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:48:51.352612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:48:51.447855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3567-5798-4101-afd2-cc5c2f9bfdbc None admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:48:51.479314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:48:51.479939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:48:51.480232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:48:51.480512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:48:51.481254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:48:51.482640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddae5aa-07cf-42e9-b743-30942b6f0353 None admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:48:51.589007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 646/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Feb 28 12:48:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:54:55.953272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:55.954249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:55.954729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:55.962037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7097-a3c8-45bb-bed1-2247a1700b56 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:55.962892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7097-a3c8-45bb-bed1-2247a1700b56 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:55.963378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7097-a3c8-45bb-bed1-2247a1700b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:55.967172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 661/1307] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:54:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:54:56.050486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-118a7097-a3c8-45bb-bed1-2247a1700b56 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:54:56.052084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-118a7097-a3c8-45bb-bed1-2247a1700b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:56.171911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 647/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:54:56.182499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:54:56.184516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:56.327703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210abfa-ea9b-4d1d-9ecd-21ccbd210b05 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:54:56.436444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:54:56.437341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:56.437753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:56.438029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:56.438884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:54:56.441076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:54:56.441076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 12:54:56.441076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 12:54:56.443179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3b84b-c272-4cd1-a7b1-eb372cb764c6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:54:56.480267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 662/1309] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:54:56 2022] GET /identity/v3/projects => generated 2553 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:54:58.845086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef3e8-3b69-426f-be2f-4e7eb608dde0 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:58.846027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef3e8-3b69-426f-be2f-4e7eb608dde0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:58.846517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ef3e8-3b69-426f-be2f-4e7eb608dde0 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:58.852638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 648/1310] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:54:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:54:58.854524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09c33-c2f6-4d2f-a9e6-6c250ca40987 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:58.854950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09c33-c2f6-4d2f-a9e6-6c250ca40987 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:58.855167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09c33-c2f6-4d2f-a9e6-6c250ca40987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:58.923652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-73f09c33-c2f6-4d2f-a9e6-6c250ca40987 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:54:58.924857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-73f09c33-c2f6-4d2f-a9e6-6c250ca40987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:59.030401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 663/1311] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:54:59.080150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:59.080342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:59.080719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:59.082922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 649/1312] 10.222.0.23 () {54 vars in 964 bytes} [Mon Feb 28 12:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:54:59.088859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e88f-5691-40d5-bb61-54d81f23ce31 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:59.089230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e88f-5691-40d5-bb61-54d81f23ce31 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:59.089591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3e88f-5691-40d5-bb61-54d81f23ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:59.163295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-99f3e88f-5691-40d5-bb61-54d81f23ce31 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:54:59.164662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-99f3e88f-5691-40d5-bb61-54d81f23ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:59.251324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 664/1313] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Feb 28 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:54:59.261290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:54:59.262809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:59.385384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2fca9-c149-4629-b724-18130c59fd27 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:54:59.471645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:54:59.472321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:54:59.472609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:54:59.472916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:54:59.474801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:54:59.593032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:54:59.594493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83737479-8d82-4d57-b010-3b9140579f8c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:54:59.616563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 650/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:02.182708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d90b6-52c2-445f-9a61-19ded031f16c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:02.183229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d90b6-52c2-445f-9a61-19ded031f16c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:02.183229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d90b6-52c2-445f-9a61-19ded031f16c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:02.185003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 665/1315] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:02.190502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07fe-b251-4685-b10b-db9b1ecc988a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:02.190894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07fe-b251-4685-b10b-db9b1ecc988a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:02.191075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af07fe-b251-4685-b10b-db9b1ecc988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:02.254576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-54af07fe-b251-4685-b10b-db9b1ecc988a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:02.255797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-54af07fe-b251-4685-b10b-db9b1ecc988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:02.346523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 651/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:02.401439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:02.401750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:02.402035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:02.403885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 666/1317] 10.222.0.23 () {54 vars in 964 bytes} [Mon Feb 28 12:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:02.409737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b94db-a34c-4c98-a9ee-33b970f72ee6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:02.410026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b94db-a34c-4c98-a9ee-33b970f72ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:02.410302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b94db-a34c-4c98-a9ee-33b970f72ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:02.480337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-747b94db-a34c-4c98-a9ee-33b970f72ee6 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:02.481446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-747b94db-a34c-4c98-a9ee-33b970f72ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:02.551334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 652/1318] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Feb 28 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:02.560365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:02.562140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:02.661750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfaf2-fc56-4030-adb4-d82a3308e7f4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:02.730757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:02.731323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:02.731637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:02.731915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:02.733514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:02.834079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:02.836046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ec6a-e473-4567-92bd-b149261c9d73 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:02.853437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 667/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:05.862336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:05.862866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:05.862964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:05.864745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 653/1320] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:05.869984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b223d6-b081-41b1-b256-99299c3f616e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:05.870428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b223d6-b081-41b1-b256-99299c3f616e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:05.870524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b223d6-b081-41b1-b256-99299c3f616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:05.932326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f4b223d6-b081-41b1-b256-99299c3f616e None None] MFA Rules not processed for user `1b58e128d5794770a80daa121740fb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:05.933537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f4b223d6-b081-41b1-b256-99299c3f616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:06.024879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 668/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:06.064676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:06.066188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:06.165556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdadd6-a96e-45d0-ac9b-f57a9af483d6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:06.235610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:06.236256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:06.236543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:06.236823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:06.238503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:06.344214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:06.345636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef3d7a-17ea-4eb9-9c59-8153a3bbd99d service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:06.362743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 654/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:09.534641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:09.535172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:09.535286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:09.537037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 669/1323] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:09.542960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f53-3576-4b5f-8d29-476370b970d3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:09.543363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f53-3576-4b5f-8d29-476370b970d3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:09.543564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f53-3576-4b5f-8d29-476370b970d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:09.605377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1ec71f53-3576-4b5f-8d29-476370b970d3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:09.606573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1ec71f53-3576-4b5f-8d29-476370b970d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:09.696839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 655/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:09.736373 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:09.737884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:09.835218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20224f1-cfe7-4b6f-9ace-4c2c2b8c89f4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:09.903782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:09.904412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:09.904696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:09.904997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:09.906593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:10.010415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:10.011910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37440-670e-4bac-8f78-710b7f519554 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:10.029800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 670/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:13.276984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:13.277481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:13.277481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:13.279279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 656/1326] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:13.284652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e68ea-cdd1-4725-87cc-b6d35499e009 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:13.285076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e68ea-cdd1-4725-87cc-b6d35499e009 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:13.285210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e68ea-cdd1-4725-87cc-b6d35499e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:13.347151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-256e68ea-cdd1-4725-87cc-b6d35499e009 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:13.348371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-256e68ea-cdd1-4725-87cc-b6d35499e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:13.439011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 671/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:13.474261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:13.475908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:13.574141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceac96-fdfa-43dc-a78b-7ce26f23e078 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:13.643773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:13.644419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:13.644705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:13.644981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:13.646626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:13.754626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:13.756113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050245a5-4430-4afc-9acc-186e0f1a7e8d service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:13.773645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 657/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:16.112456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:16.113011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:16.113011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:16.114970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 672/1329] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:16.120326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7999-da11-44f3-8698-4937cb1645d7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:16.120715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7999-da11-44f3-8698-4937cb1645d7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:16.121003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7999-da11-44f3-8698-4937cb1645d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:16.186758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a77b7999-da11-44f3-8698-4937cb1645d7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:16.196843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a77b7999-da11-44f3-8698-4937cb1645d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:16.283157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 658/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:55:16.319701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:16.321215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:16.422185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177c84-9ed8-4d27-80ac-f9c6a624b14c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:16.493852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:16.494463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:16.494746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:16.495022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:16.496671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:16.600807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:16.602239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673cc1c-b52b-4a11-ad46-b27d0126aa7a service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:16.619419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 673/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 12:55:18.958088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:18.958615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:18.958703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:18.961365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 659/1332] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:18.966504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca01e-a8e8-4ae6-8d14-e89cee139e1f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:18.966954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca01e-a8e8-4ae6-8d14-e89cee139e1f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:18.967059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ca01e-a8e8-4ae6-8d14-e89cee139e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:19.029291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-857ca01e-a8e8-4ae6-8d14-e89cee139e1f None None] MFA Rules not processed for user `1b58e128d5794770a80daa121740fb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:19.030491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-857ca01e-a8e8-4ae6-8d14-e89cee139e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:19.120909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 674/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:19.158856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:19.160478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:19.261761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13196b1-565d-489c-810a-cf5a5608e9e7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:19.332010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:19.332651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:19.332934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:19.333208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:19.334862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:19.438369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:19.439839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041538aa-b077-485a-b902-f8d8a04d6925 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:19.457460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 660/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:22.177323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:22.177886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:22.177886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:22.179712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 675/1335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:22.185410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f291f-00dc-4246-8e08-b5c5ee90e30e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:22.186118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f291f-00dc-4246-8e08-b5c5ee90e30e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:22.186248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f291f-00dc-4246-8e08-b5c5ee90e30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:22.253784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-296f291f-00dc-4246-8e08-b5c5ee90e30e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:22.255057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-296f291f-00dc-4246-8e08-b5c5ee90e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:22.351340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 661/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:22.387788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:22.389365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:22.499699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76add310-e95a-4f4a-ba22-0672c2dbf2d6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:22.573757 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:22.574509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:22.574875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:22.575158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:22.576843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:22.686157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:22.687765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20eac9-7c4f-4ce2-84a5-7c7a4041b48a service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:22.705253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 676/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:25.036385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:25.036889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:25.036982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:25.038767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 662/1338] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:25.043926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f302-9b5e-473e-906b-bface20c09f4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:25.044370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f302-9b5e-473e-906b-bface20c09f4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:25.044496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854f302-9b5e-473e-906b-bface20c09f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:25.107988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0854f302-9b5e-473e-906b-bface20c09f4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:25.109176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0854f302-9b5e-473e-906b-bface20c09f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:25.200411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 677/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:25.240520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:25.242536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:25.343840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8cd4-7728-4da9-b917-1e1bdbb6cb67 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:25.413663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:25.414306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:25.414588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:25.414888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:25.416528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:25.520659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:25.522031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b278ed-7065-4ef1-b29b-7f3ce4ff1f44 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:25.539108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 663/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:28.355723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:28.356277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:28.356277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:28.358101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 678/1341] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:28.363453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1cb99-26d4-4f74-bb44-821bd09854cf None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:28.363894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1cb99-26d4-4f74-bb44-821bd09854cf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:28.364039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1cb99-26d4-4f74-bb44-821bd09854cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:28.429984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-42d1cb99-26d4-4f74-bb44-821bd09854cf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:28.431168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-42d1cb99-26d4-4f74-bb44-821bd09854cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:28.528173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 664/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:28.564426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:28.566630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:28.656975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5d1df-2923-43ff-8cfd-d42efcd9bd9b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:28.660462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:28.661091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:28.661377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:28.661655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:28.670301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:28.671748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0425e29-8fc8-4a2b-aa35-dd9381925507 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:28.680829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 679/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:33.102926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd639bd-98ef-4992-9b9b-8374ba9d197c None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:33.103446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd639bd-98ef-4992-9b9b-8374ba9d197c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:33.103590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd639bd-98ef-4992-9b9b-8374ba9d197c None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:33.105268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 665/1344] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:33.110500 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5833f-8172-4c5b-a57a-90218bc1c8a6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:33.110956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5833f-8172-4c5b-a57a-90218bc1c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:33.111063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5833f-8172-4c5b-a57a-90218bc1c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:33.139061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-23a5833f-8172-4c5b-a57a-90218bc1c8a6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:33.140275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-23a5833f-8172-4c5b-a57a-90218bc1c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:33.212968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 680/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:33.252459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd639bd-98ef-4992-9b9b-8374ba9d197c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:33.262942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd639bd-98ef-4992-9b9b-8374ba9d197c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:33.266504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:33.267126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:33.267407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:33.267712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:33.276547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:33.278004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bee21-b867-4e42-985d-4901bd33f338 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:33.287414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 666/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:36.496704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dcaa-e686-4dcf-b01f-85f3bf54ef00 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:36.497202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dcaa-e686-4dcf-b01f-85f3bf54ef00 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:36.497202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87dcaa-e686-4dcf-b01f-85f3bf54ef00 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:36.498946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 681/1347] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:36.504143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca990c6-6f49-4b95-bfa7-e9d08d13d7e6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:36.504567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca990c6-6f49-4b95-bfa7-e9d08d13d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:36.504701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca990c6-6f49-4b95-bfa7-e9d08d13d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:36.522774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-fca990c6-6f49-4b95-bfa7-e9d08d13d7e6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:36.523984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fca990c6-6f49-4b95-bfa7-e9d08d13d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:36.531655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 667/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:36.569591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87dcaa-e686-4dcf-b01f-85f3bf54ef00 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:36.579928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87dcaa-e686-4dcf-b01f-85f3bf54ef00 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:36.583324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:36.583974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:36.584259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:36.585108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:36.594036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:36.595453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5130329-941c-466e-9541-dbc18161a456 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:36.605375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 682/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:41.102372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a9e1-2483-4397-8b48-db3869683547 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:41.102897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a9e1-2483-4397-8b48-db3869683547 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:41.102897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4a9e1-2483-4397-8b48-db3869683547 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:41.104784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 668/1350] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:41.110107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede06-948e-4dd2-8e12-e814ef559e89 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:41.110557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede06-948e-4dd2-8e12-e814ef559e89 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:41.110661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede06-948e-4dd2-8e12-e814ef559e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:41.128595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6cdede06-948e-4dd2-8e12-e814ef559e89 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:41.129709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6cdede06-948e-4dd2-8e12-e814ef559e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:41.138041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 683/1351] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:41.175145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4a9e1-2483-4397-8b48-db3869683547 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:41.186453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4a9e1-2483-4397-8b48-db3869683547 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:41.189925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:41.190553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:41.190833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:41.191109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:41.200371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:41.201805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf3ff-a3da-4b99-91e9-3f61d9d18132 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:41.211354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 669/1352] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:46.356527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8902a-8440-4943-87b3-220efaf4c9a1 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:46.357414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8902a-8440-4943-87b3-220efaf4c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:46.357839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8902a-8440-4943-87b3-220efaf4c9a1 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:46.360177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 684/1353] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 12:55:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:46.367282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d2c-9f14-4bbf-ac3b-5630d77eb435 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:46.368140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d2c-9f14-4bbf-ac3b-5630d77eb435 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:46.368431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d2c-9f14-4bbf-ac3b-5630d77eb435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:46.471656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e1273d2c-9f14-4bbf-ac3b-5630d77eb435 None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:46.473150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e1273d2c-9f14-4bbf-ac3b-5630d77eb435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:46.557347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 670/1354] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 12:55:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:55:50.761677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa06b5-93ec-46df-93ac-c4e869a5c6f0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:50.762270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa06b5-93ec-46df-93ac-c4e869a5c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:50.762270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa06b5-93ec-46df-93ac-c4e869a5c6f0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:50.764024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 685/1355] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 12:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:50.770119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631673-269c-4ecd-8227-713537861f75 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:50.770549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631673-269c-4ecd-8227-713537861f75 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:50.770668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631673-269c-4ecd-8227-713537861f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:50.788763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ac631673-269c-4ecd-8227-713537861f75 None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:50.790038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ac631673-269c-4ecd-8227-713537861f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:50.798587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 671/1356] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:52.511616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983520-b2d2-4070-aed3-e3b401867721 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:52.512202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983520-b2d2-4070-aed3-e3b401867721 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:52.512202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983520-b2d2-4070-aed3-e3b401867721 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:52.514025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 686/1357] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 12:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:52.519836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138cbf-96f1-43a3-b55b-2f02ba9c086c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:52.520427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138cbf-96f1-43a3-b55b-2f02ba9c086c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:52.520427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138cbf-96f1-43a3-b55b-2f02ba9c086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:52.540337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-db138cbf-96f1-43a3-b55b-2f02ba9c086c None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:52.541577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-db138cbf-96f1-43a3-b55b-2f02ba9c086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:52.550597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 672/1358] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:56.243352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461742-3968-46be-9f8b-c836b2a17160 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:56.243895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461742-3968-46be-9f8b-c836b2a17160 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:56.243895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461742-3968-46be-9f8b-c836b2a17160 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:56.245779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 687/1359] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:56.250993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff034e1-7d71-4095-a60d-a87aa68ff66f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:56.251748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff034e1-7d71-4095-a60d-a87aa68ff66f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:56.252030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff034e1-7d71-4095-a60d-a87aa68ff66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:56.270739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5ff034e1-7d71-4095-a60d-a87aa68ff66f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:56.272044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5ff034e1-7d71-4095-a60d-a87aa68ff66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:56.280057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 673/1360] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:56.327597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819357c-5d04-4fde-a06e-041980d1b8dc None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:56.327970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819357c-5d04-4fde-a06e-041980d1b8dc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:56.328346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819357c-5d04-4fde-a06e-041980d1b8dc None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:56.330170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 688/1361] 10.222.0.23 () {54 vars in 961 bytes} [Mon Feb 28 12:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:56.335336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283b5e-10a5-4886-b742-ecd79fcd434f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:56.335660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283b5e-10a5-4886-b742-ecd79fcd434f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:56.335945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283b5e-10a5-4886-b742-ecd79fcd434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:56.395768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-01283b5e-10a5-4886-b742-ecd79fcd434f None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:56.396996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-01283b5e-10a5-4886-b742-ecd79fcd434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:56.488113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 674/1362] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Feb 28 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:56.497601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819357c-5d04-4fde-a06e-041980d1b8dc None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:56.513886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819357c-5d04-4fde-a06e-041980d1b8dc None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:56.519845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:56.520564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:56.520913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:56.521904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:56.530539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:56.532247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5db4e-5621-417e-a441-f8a14754baca service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:56.543125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 689/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:55:59.065703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec5ad-3d9f-4be7-af51-c68c4e37ca21 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:59.066596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec5ad-3d9f-4be7-af51-c68c4e37ca21 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:59.066877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cec5ad-3d9f-4be7-af51-c68c4e37ca21 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:59.068772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 675/1364] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:55:59.074180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e299-860c-4309-952b-e48f14a222ce None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:59.074586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e299-860c-4309-952b-e48f14a222ce None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:59.074734 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e299-860c-4309-952b-e48f14a222ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:59.095094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-fb92e299-860c-4309-952b-e48f14a222ce None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:55:59.096669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fb92e299-860c-4309-952b-e48f14a222ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:55:59.105695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 690/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:55:59.150637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cec5ad-3d9f-4be7-af51-c68c4e37ca21 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:55:59.165733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cec5ad-3d9f-4be7-af51-c68c4e37ca21 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:55:59.171314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:55:59.172036 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:55:59.172325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:55:59.172606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:55:59.180612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:55:59.182212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c22b9d-8614-4d29-9b03-b14b101ee1ab service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:55:59.192256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 676/1366] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:01.923747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df2e78-b2ed-4868-a2a4-b5d73c1382f0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:01.924262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df2e78-b2ed-4868-a2a4-b5d73c1382f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:01.924351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df2e78-b2ed-4868-a2a4-b5d73c1382f0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:01.926080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 691/1367] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:01.931901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c6f2-6956-4d42-aebf-7a19afd6f14e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:01.932322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c6f2-6956-4d42-aebf-7a19afd6f14e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:01.932458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89c6f2-6956-4d42-aebf-7a19afd6f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:01.950726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ca89c6f2-6956-4d42-aebf-7a19afd6f14e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:01.951963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ca89c6f2-6956-4d42-aebf-7a19afd6f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:01.960593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 677/1368] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:02.005360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea6f63-fff2-48f5-897b-a7ba52e08e34 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:02.005652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea6f63-fff2-48f5-897b-a7ba52e08e34 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:02.005983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea6f63-fff2-48f5-897b-a7ba52e08e34 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:02.007765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 692/1369] 10.222.0.23 () {54 vars in 961 bytes} [Mon Feb 28 12:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:02.013226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feaa1-56c2-40e7-a6b2-4c8457b4317a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:02.013588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feaa1-56c2-40e7-a6b2-4c8457b4317a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:02.013940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feaa1-56c2-40e7-a6b2-4c8457b4317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:02.032332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4e9feaa1-56c2-40e7-a6b2-4c8457b4317a None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:02.033518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4e9feaa1-56c2-40e7-a6b2-4c8457b4317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:02.043255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 678/1370] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Feb 28 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:56:02.050829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea6f63-fff2-48f5-897b-a7ba52e08e34 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:02.065733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea6f63-fff2-48f5-897b-a7ba52e08e34 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:02.072471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:02.073295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:02.073580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:02.073857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:02.092153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:02.094312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6024e2d-e07f-4964-a787-17cac59f8487 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:02.107298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 693/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:04.536987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504fa59-efb6-4636-a48d-ad8704a03827 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.537542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504fa59-efb6-4636-a48d-ad8704a03827 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.537808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504fa59-efb6-4636-a48d-ad8704a03827 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.539853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 679/1372] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:04.545305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.545722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.545858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.565568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:04.566928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:04.571339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fcb98-c6a4-420a-b7da-8067971a0546 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.571665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fcb98-c6a4-420a-b7da-8067971a0546 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.571948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fcb98-c6a4-420a-b7da-8067971a0546 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.573714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 680/1373] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 12:56:04.578636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba7a8-ba7d-4a6e-a87c-75187e94f39a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.578921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba7a8-ba7d-4a6e-a87c-75187e94f39a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.579208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba7a8-ba7d-4a6e-a87c-75187e94f39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.580410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 694/1374] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:04.596903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b1fba7a8-ba7d-4a6e-a87c-75187e94f39a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:04.598107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b1fba7a8-ba7d-4a6e-a87c-75187e94f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:04.606697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 681/1375] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:56:04.651752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:04.665120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f474-c126-439a-9773-5e7414673ff6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:04.670582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:04.671337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.671776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.672055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.681032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:04.682920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a0513-beea-4fbb-8a2b-ee5ccaec47bc service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:04.692782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 695/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:04.871999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa461-8fd0-4bbd-9889-8c0aada90274 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.874674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa461-8fd0-4bbd-9889-8c0aada90274 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.874674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa461-8fd0-4bbd-9889-8c0aada90274 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.874674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 682/1377] 10.222.0.23 () {54 vars in 963 bytes} [Mon Feb 28 12:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:04.880453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75431af-fd75-4a60-abac-4195925be9fa None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:04.880863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75431af-fd75-4a60-abac-4195925be9fa None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:04.881213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75431af-fd75-4a60-abac-4195925be9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:04.953016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b75431af-fd75-4a60-abac-4195925be9fa None None] MFA Rules not processed for user `6793eba624e644a9ba49910428cdb515`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:04.954274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b75431af-fd75-4a60-abac-4195925be9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:05.027751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 696/1378] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Feb 28 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:05.035563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa461-8fd0-4bbd-9889-8c0aada90274 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:05.047957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa461-8fd0-4bbd-9889-8c0aada90274 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:05.051921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:05.053325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:05.053325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:05.053533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:05.064693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:05.066217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bbee9-247d-4811-a6ec-1637c16f9d33 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:05.076493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 683/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:07.181034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160d88-8245-4349-bcd1-a9b02efd161a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:07.181558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160d88-8245-4349-bcd1-a9b02efd161a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:07.181646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d160d88-8245-4349-bcd1-a9b02efd161a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:07.183386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 697/1380] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:07.189055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74364cf-625c-4c76-a6fd-50328e67c480 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:07.189505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74364cf-625c-4c76-a6fd-50328e67c480 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:07.189708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74364cf-625c-4c76-a6fd-50328e67c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:07.208421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f74364cf-625c-4c76-a6fd-50328e67c480 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:07.210172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f74364cf-625c-4c76-a6fd-50328e67c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:07.218277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 684/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:07.263093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160d88-8245-4349-bcd1-a9b02efd161a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:07.278052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d160d88-8245-4349-bcd1-a9b02efd161a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:07.283940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:07.287691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:07.287691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:07.287691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:07.294638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:07.296274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b5cc5-9469-46ef-b618-7a3730b4d888 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:07.305827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 698/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:09.737030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9db40-1e5f-4566-82bd-5edea2c27c70 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:09.737562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9db40-1e5f-4566-82bd-5edea2c27c70 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:09.737562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9db40-1e5f-4566-82bd-5edea2c27c70 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:09.739369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 685/1383] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:09.745098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcd23-64ad-4135-ac58-f6079a417a6e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:09.745480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcd23-64ad-4135-ac58-f6079a417a6e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:09.745658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddcd23-64ad-4135-ac58-f6079a417a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:09.763653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d3ddcd23-64ad-4135-ac58-f6079a417a6e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:09.764836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d3ddcd23-64ad-4135-ac58-f6079a417a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:09.772857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 699/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:09.816332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9db40-1e5f-4566-82bd-5edea2c27c70 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:09.831564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9db40-1e5f-4566-82bd-5edea2c27c70 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:09.837190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:09.837920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:09.838406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:09.838779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:09.846744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:09.848566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65c246-a630-4eea-90cc-13ac4a289445 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:09.858627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 686/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:12.324333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b41be-3601-4e29-add7-38b559d9cc35 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:12.325218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b41be-3601-4e29-add7-38b559d9cc35 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:12.325660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b41be-3601-4e29-add7-38b559d9cc35 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:12.327446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 700/1386] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:12.332735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda28c-2ee0-46fa-8a1c-ad0df05ff4cf None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:12.333166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda28c-2ee0-46fa-8a1c-ad0df05ff4cf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:12.333298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda28c-2ee0-46fa-8a1c-ad0df05ff4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:12.351849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c8dda28c-2ee0-46fa-8a1c-ad0df05ff4cf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:12.353838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c8dda28c-2ee0-46fa-8a1c-ad0df05ff4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:12.363193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 687/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:12.404891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b41be-3601-4e29-add7-38b559d9cc35 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:12.419498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b41be-3601-4e29-add7-38b559d9cc35 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:12.425187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:12.425810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:12.426090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:12.426362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:12.435851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:12.437655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9140cd-03de-4c12-92b0-45db9e1549da service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:12.448468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 701/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:14.994366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a565-9612-4015-b3cc-49b020c30447 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:14.994977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a565-9612-4015-b3cc-49b020c30447 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:14.994977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110a565-9612-4015-b3cc-49b020c30447 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:14.996732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 688/1389] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:15.002177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0399-bbbd-4598-9803-25969b3b23fb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:15.002605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0399-bbbd-4598-9803-25969b3b23fb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:15.002703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0399-bbbd-4598-9803-25969b3b23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:15.020405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cd4b0399-bbbd-4598-9803-25969b3b23fb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:15.022121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cd4b0399-bbbd-4598-9803-25969b3b23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:15.029977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 702/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:15.073451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a565-9612-4015-b3cc-49b020c30447 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:15.088422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110a565-9612-4015-b3cc-49b020c30447 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:15.093901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:15.094544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:15.094830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:15.095107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:15.103989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:15.105605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d784260-37d7-47b3-9d77-0abb8c0ef1ec service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:15.114982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 689/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:17.578668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812b96-e22b-402c-9606-4245dc1c9269 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:17.579191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812b96-e22b-402c-9606-4245dc1c9269 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:17.579286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63812b96-e22b-402c-9606-4245dc1c9269 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:17.581265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 703/1392] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:17.586799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f4b-1a74-425a-bd45-b5f255888fb4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:17.587229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f4b-1a74-425a-bd45-b5f255888fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:17.587587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f4b-1a74-425a-bd45-b5f255888fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:17.609388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c9ef3f4b-1a74-425a-bd45-b5f255888fb4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:17.610962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c9ef3f4b-1a74-425a-bd45-b5f255888fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:17.621600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 690/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:17.666902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63812b96-e22b-402c-9606-4245dc1c9269 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:17.681504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63812b96-e22b-402c-9606-4245dc1c9269 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:17.687291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:17.687946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:17.688227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:17.688502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:17.696678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:17.698215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4775b6-2326-495d-87fd-3a7f3667ae44 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:17.707364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 704/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:20.292671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b036b-3480-44dd-b4c3-889ac51a6c94 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:20.293232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b036b-3480-44dd-b4c3-889ac51a6c94 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:20.293232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b036b-3480-44dd-b4c3-889ac51a6c94 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:20.294910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 691/1395] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:20.300234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fdcbb-ea13-4399-9bf1-f8ac6983c0c4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:20.300664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fdcbb-ea13-4399-9bf1-f8ac6983c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:20.300807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fdcbb-ea13-4399-9bf1-f8ac6983c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:20.319523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c43fdcbb-ea13-4399-9bf1-f8ac6983c0c4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:20.320713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c43fdcbb-ea13-4399-9bf1-f8ac6983c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:20.328859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 705/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:20.372174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b036b-3480-44dd-b4c3-889ac51a6c94 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:20.386157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b036b-3480-44dd-b4c3-889ac51a6c94 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:20.391741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:20.392382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:20.392670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:20.392949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:20.401374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:20.403037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792c363-9097-46b8-ac5e-20f4d52464e9 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:20.412950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 692/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:21.592728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f476c-ff88-4d36-a924-95a9b077a329 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:21.593290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f476c-ff88-4d36-a924-95a9b077a329 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:21.593405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f476c-ff88-4d36-a924-95a9b077a329 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:21.595151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 706/1398] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:21.600395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cc398-7705-463d-9e34-6169cf6ff9a5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:21.600796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cc398-7705-463d-9e34-6169cf6ff9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:21.600950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cc398-7705-463d-9e34-6169cf6ff9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:21.618810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3f9cc398-7705-463d-9e34-6169cf6ff9a5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:21.620020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3f9cc398-7705-463d-9e34-6169cf6ff9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:21.627689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 693/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:21.683837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19953c-64eb-4ad1-b8df-172900fb8aa6 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:21.684124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19953c-64eb-4ad1-b8df-172900fb8aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:21.684395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19953c-64eb-4ad1-b8df-172900fb8aa6 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:21.686396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 707/1400] 10.222.0.23 () {54 vars in 962 bytes} [Mon Feb 28 12:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:21.691185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63758-259f-438e-9ec7-a079d8d958e8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:21.691494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63758-259f-438e-9ec7-a079d8d958e8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:21.691787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e63758-259f-438e-9ec7-a079d8d958e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:21.741720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-86e63758-259f-438e-9ec7-a079d8d958e8 None None] MFA Rules not processed for user `b8d34ef4b64a42a897fa75e8b14c60f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:21.742919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-86e63758-259f-438e-9ec7-a079d8d958e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:21.798542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 694/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Feb 28 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:21.806495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19953c-64eb-4ad1-b8df-172900fb8aa6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:21.816981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19953c-64eb-4ad1-b8df-172900fb8aa6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:21.821253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:21.821869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:21.822170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:21.822428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:21.831523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:21.832948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0694cd0-f70e-482d-8ecb-bb002936b2e5 service glance] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:21.841906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 708/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:22.435251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12d39-93ee-4906-b7b3-210a92f3048e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.435571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12d39-93ee-4906-b7b3-210a92f3048e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.435849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12d39-93ee-4906-b7b3-210a92f3048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.482800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9ab12d39-93ee-4906-b7b3-210a92f3048e None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:22.483940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9ab12d39-93ee-4906-b7b3-210a92f3048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:22.548247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 695/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 12:56:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:22.589929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c43806-645d-4546-9abc-1c9199f72e91 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.590300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c43806-645d-4546-9abc-1c9199f72e91 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.590664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c43806-645d-4546-9abc-1c9199f72e91 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.592594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 709/1404] 10.222.0.23 () {54 vars in 942 bytes} [Mon Feb 28 12:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:22.598862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdb37-2a13-4213-b208-c3181add46b8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.599864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdb37-2a13-4213-b208-c3181add46b8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.600214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdb37-2a13-4213-b208-c3181add46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.648119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-842fdb37-2a13-4213-b208-c3181add46b8 None None] MFA Rules not processed for user `acf32cc208ae41bb83c0248bbcfe74a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:22.649305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-842fdb37-2a13-4213-b208-c3181add46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:22.718581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 696/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Mon Feb 28 12:56:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:56:22.727905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c43806-645d-4546-9abc-1c9199f72e91 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:22.740929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c43806-645d-4546-9abc-1c9199f72e91 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:22.745659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:22.746287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.746568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.746844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.754658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:22.756776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6d0d3-f1d5-460a-a482-85dd9ce5d8ce service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:22.764500 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 710/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 12:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 12:56:22.898159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7dfc-e594-4b0f-9ba0-03645f4b5e54 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.898443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7dfc-e594-4b0f-9ba0-03645f4b5e54 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.898717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7dfc-e594-4b0f-9ba0-03645f4b5e54 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.900532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 697/1407] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:22.907253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460053-453a-4f31-8a4f-b9256334a098 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:22.907253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460053-453a-4f31-8a4f-b9256334a098 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:22.907253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f460053-453a-4f31-8a4f-b9256334a098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:22.923984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0f460053-453a-4f31-8a4f-b9256334a098 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:22.925302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0f460053-453a-4f31-8a4f-b9256334a098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:22.933186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 711/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:22.979580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7dfc-e594-4b0f-9ba0-03645f4b5e54 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:22.997776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7dfc-e594-4b0f-9ba0-03645f4b5e54 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:23.000185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:23.000822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:23.001108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:23.001386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:23.010307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:23.012023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ca9e3-bc21-4b55-8189-f3106cbfb8c9 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:23.021142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 698/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:25.501107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6a7a-65d6-4c4d-8265-b202338674ed None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:25.501672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6a7a-65d6-4c4d-8265-b202338674ed None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:25.501672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6a7a-65d6-4c4d-8265-b202338674ed None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:25.503528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 712/1410] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:25.509964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52cb7-bb4b-44ee-96c7-5f9bec6c3e20 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:25.510384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52cb7-bb4b-44ee-96c7-5f9bec6c3e20 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:25.510550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52cb7-bb4b-44ee-96c7-5f9bec6c3e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:25.528198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4dc52cb7-bb4b-44ee-96c7-5f9bec6c3e20 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:25.529401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4dc52cb7-bb4b-44ee-96c7-5f9bec6c3e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:25.539122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 699/1411] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:25.583953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df6a7a-65d6-4c4d-8265-b202338674ed None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:25.599838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df6a7a-65d6-4c4d-8265-b202338674ed None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:25.605328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:25.606060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:25.606412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:25.606759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:25.617598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:25.619344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77226bd7-68ba-4106-b04c-27abba2061c4 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:25.639732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 713/1412] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:47.165451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09c97-3cbc-4b5e-ac1e-3a875d6ea667 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:47.166063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09c97-3cbc-4b5e-ac1e-3a875d6ea667 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:47.166063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e09c97-3cbc-4b5e-ac1e-3a875d6ea667 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:47.167844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 700/1413] 10.222.0.23 () {54 vars in 918 bytes} [Mon Feb 28 12:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:47.173064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8857-0bac-43ba-854b-f9e2542e2f46 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:47.173516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8857-0bac-43ba-854b-f9e2542e2f46 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:47.173651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8857-0bac-43ba-854b-f9e2542e2f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:47.191836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ca6c8857-0bac-43ba-854b-f9e2542e2f46 None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:47.193019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ca6c8857-0bac-43ba-854b-f9e2542e2f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:47.201944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 714/1414] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Feb 28 12:56:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:56:47.215639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2f5b-b845-4c10-b4b9-e2691964852e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:47.215927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2f5b-b845-4c10-b4b9-e2691964852e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:47.216204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2f5b-b845-4c10-b4b9-e2691964852e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:47.217964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 701/1415] 10.222.0.23 () {54 vars in 918 bytes} [Mon Feb 28 12:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:47.222542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71bc4-9428-46c0-8559-05091bf4d1a2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:47.229859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71bc4-9428-46c0-8559-05091bf4d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:47.229859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71bc4-9428-46c0-8559-05091bf4d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:47.240321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-7ed71bc4-9428-46c0-8559-05091bf4d1a2 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:47.242008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7ed71bc4-9428-46c0-8559-05091bf4d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:47.250792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 715/1416] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Feb 28 12:56:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:49.972265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457ee66-e03e-4e79-987f-668969d6b2e4 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:49.972701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457ee66-e03e-4e79-987f-668969d6b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:49.972827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457ee66-e03e-4e79-987f-668969d6b2e4 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:49.974589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:49.979877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4db74-1550-483d-a643-4de693215cdf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:49.980251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4db74-1550-483d-a643-4de693215cdf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:49.980451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4db74-1550-483d-a643-4de693215cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:49.998756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b6b4db74-1550-483d-a643-4de693215cdf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:49.999991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b6b4db74-1550-483d-a643-4de693215cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:50.008320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:50.048885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457ee66-e03e-4e79-987f-668969d6b2e4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:50.063665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457ee66-e03e-4e79-987f-668969d6b2e4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:50.069005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:50.070239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:50.070523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:50.070804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:50.078761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:50.080386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cfb1b-f40b-4eca-b519-3aac5ab8acfb service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:50.089597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 703/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:51.423970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57e9e-d25b-481e-8a60-33f33e5a33f0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:51.424579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57e9e-d25b-481e-8a60-33f33e5a33f0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:51.424579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57e9e-d25b-481e-8a60-33f33e5a33f0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:51.426302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:51.431835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd25977-b615-43f5-8911-1b008492df52 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:51.432262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd25977-b615-43f5-8911-1b008492df52 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:51.432367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd25977-b615-43f5-8911-1b008492df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:51.450673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0bd25977-b615-43f5-8911-1b008492df52 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:51.451915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0bd25977-b615-43f5-8911-1b008492df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:51.459826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:51.622910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57e9e-d25b-481e-8a60-33f33e5a33f0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:51.636752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57e9e-d25b-481e-8a60-33f33e5a33f0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:51.642180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:51.642831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:51.643114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:51.643389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:51.651889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:51.653455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a166e54-3fe7-48ea-ac5c-d0fcdd8c4e1a service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:51.662379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 718/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:52.972157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55bad-a364-4b2c-b97d-757269d01f01 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:52.972627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55bad-a364-4b2c-b97d-757269d01f01 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:52.972725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55bad-a364-4b2c-b97d-757269d01f01 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:52.974467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:52.979909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006a00c-13ac-4ab5-afc8-598144b8bfc4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:52.980305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006a00c-13ac-4ab5-afc8-598144b8bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:52.980469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006a00c-13ac-4ab5-afc8-598144b8bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:52.998242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e006a00c-13ac-4ab5-afc8-598144b8bfc4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:52.999438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e006a00c-13ac-4ab5-afc8-598144b8bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:53.007129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:53.156253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a55bad-a364-4b2c-b97d-757269d01f01 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:53.170547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a55bad-a364-4b2c-b97d-757269d01f01 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:53.175855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:53.176478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:53.176758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:53.177029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:53.185091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:53.186672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c2b16-a1fb-4568-9c6e-04a93a603b9b service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:53.195697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 706/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:54.487871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a39f6-0b8a-462c-8dcd-338f3b3b8f85 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:54.488415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a39f6-0b8a-462c-8dcd-338f3b3b8f85 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:54.488415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a39f6-0b8a-462c-8dcd-338f3b3b8f85 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:54.490274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:54.495848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f2e5-203e-4ce1-b71e-2b6bc449059d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:54.496275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f2e5-203e-4ce1-b71e-2b6bc449059d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:54.496408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f2e5-203e-4ce1-b71e-2b6bc449059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:54.514512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8197f2e5-203e-4ce1-b71e-2b6bc449059d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:54.515738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8197f2e5-203e-4ce1-b71e-2b6bc449059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:54.523369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:54.673200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a39f6-0b8a-462c-8dcd-338f3b3b8f85 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:54.687788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a39f6-0b8a-462c-8dcd-338f3b3b8f85 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:54.693019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:54.693660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:54.694791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:54.695073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:54.705491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:54.707066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040b4ce-881a-43d7-9780-3152b6410c92 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:54.716930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 721/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:56.016331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da60f2-e7f0-4b99-aa39-178c64b4349e None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:56.016859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da60f2-e7f0-4b99-aa39-178c64b4349e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:56.016859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da60f2-e7f0-4b99-aa39-178c64b4349e None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:56.018662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:56.023738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331362-a52c-43a7-a30b-ab978e004e43 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:56.024113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331362-a52c-43a7-a30b-ab978e004e43 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:56.024324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64331362-a52c-43a7-a30b-ab978e004e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:56.041889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-64331362-a52c-43a7-a30b-ab978e004e43 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:56.043056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-64331362-a52c-43a7-a30b-ab978e004e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:56.050659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:56.200153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da60f2-e7f0-4b99-aa39-178c64b4349e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:56.214147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da60f2-e7f0-4b99-aa39-178c64b4349e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:56.219448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:56.220099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:56.220382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:56.220658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:56.228566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:56.230316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755c5bc-f2ef-4ee0-8e10-639d68a59a45 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:56.239521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 709/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:57.548681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807c8-e446-4da5-a030-afb4cc1fb7dc None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:57.549243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807c8-e446-4da5-a030-afb4cc1fb7dc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:57.549243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807c8-e446-4da5-a030-afb4cc1fb7dc None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:57.551323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:57.556716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66994-ce56-499c-b890-03ffdc9dc838 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:57.557122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66994-ce56-499c-b890-03ffdc9dc838 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:57.557280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66994-ce56-499c-b890-03ffdc9dc838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:57.575700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5af66994-ce56-499c-b890-03ffdc9dc838 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:57.576892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5af66994-ce56-499c-b890-03ffdc9dc838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:57.584559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:57.732938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b807c8-e446-4da5-a030-afb4cc1fb7dc None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:57.747134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b807c8-e446-4da5-a030-afb4cc1fb7dc None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:57.752840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:57.753502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:57.753786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:57.754062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:57.762877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:57.764510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b09fd-20ef-438c-a0a7-f8276fd4b070 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:57.774000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 724/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:56:59.086280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d978b-6ea4-4e3c-9370-af282371eb72 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:59.086811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d978b-6ea4-4e3c-9370-af282371eb72 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:59.086811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d978b-6ea4-4e3c-9370-af282371eb72 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:59.088629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:56:59.093486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8857d-585d-4e4e-aa1b-eedd49e64beb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:59.093931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8857d-585d-4e4e-aa1b-eedd49e64beb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:59.094076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8857d-585d-4e4e-aa1b-eedd49e64beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:59.113863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0af8857d-585d-4e4e-aa1b-eedd49e64beb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:56:59.115046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0af8857d-585d-4e4e-aa1b-eedd49e64beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:56:59.123238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:56:59.273307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d978b-6ea4-4e3c-9370-af282371eb72 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:56:59.288400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d978b-6ea4-4e3c-9370-af282371eb72 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:56:59.293926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:56:59.294560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:56:59.294845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:56:59.295117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:56:59.303027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:56:59.305245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b1880-65b5-443c-b378-d05f02807439 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:56:59.315135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 712/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:00.654970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607add-13d4-4d30-b03d-dc9a4d487415 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:00.655584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607add-13d4-4d30-b03d-dc9a4d487415 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:00.655584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607add-13d4-4d30-b03d-dc9a4d487415 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:00.657465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:00.662327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca773-4f29-4882-85ff-0eaea17e9424 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:00.663314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca773-4f29-4882-85ff-0eaea17e9424 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:00.663459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca773-4f29-4882-85ff-0eaea17e9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:00.681049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-82eca773-4f29-4882-85ff-0eaea17e9424 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:00.682252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-82eca773-4f29-4882-85ff-0eaea17e9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:00.690248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:00.840695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d607add-13d4-4d30-b03d-dc9a4d487415 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:00.854835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d607add-13d4-4d30-b03d-dc9a4d487415 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:00.860157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:00.860783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:00.861068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:00.861343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:00.869190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:00.870786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d9dfe-0d45-4736-aee4-9a2a9c459567 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:00.880128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 727/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:02.212224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2acebe-66cf-425e-8536-8898e43571cb None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:02.212773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2acebe-66cf-425e-8536-8898e43571cb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:02.212773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2acebe-66cf-425e-8536-8898e43571cb None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:02.214487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 12:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:02.219367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c720b5-b809-4149-8568-bacb7f63f7be None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:02.219845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c720b5-b809-4149-8568-bacb7f63f7be None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:02.219969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c720b5-b809-4149-8568-bacb7f63f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:02.237491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f9c720b5-b809-4149-8568-bacb7f63f7be None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:02.238693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f9c720b5-b809-4149-8568-bacb7f63f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:02.246741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:02.394602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2acebe-66cf-425e-8536-8898e43571cb None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:02.408494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2acebe-66cf-425e-8536-8898e43571cb None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:02.414275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:02.414900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:02.415187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:02.415484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:02.423295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:02.424918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2bcfb-edbd-480d-aa25-73fa0ab27916 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:02.434920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 715/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:04.604459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8ea1-0279-47d1-8067-0dca68041f86 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:04.605004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8ea1-0279-47d1-8067-0dca68041f86 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:04.605004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa8ea1-0279-47d1-8067-0dca68041f86 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:04.606791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:04.612075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdb7f-9897-46a9-97d3-d8a548560d26 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:04.612508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdb7f-9897-46a9-97d3-d8a548560d26 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:04.612656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbdb7f-9897-46a9-97d3-d8a548560d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:04.629885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-28cbdb7f-9897-46a9-97d3-d8a548560d26 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:04.631074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-28cbdb7f-9897-46a9-97d3-d8a548560d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:04.640028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:04.678689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa8ea1-0279-47d1-8067-0dca68041f86 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:04.689423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa8ea1-0279-47d1-8067-0dca68041f86 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:04.693015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:04.694204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:04.694486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:04.694759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:04.703436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:04.704888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81484429-c942-4333-a657-2c57165a4365 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:04.715792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 730/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:07.156219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:07.156817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:07.156817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:07.158559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:07.164483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eee5-8911-4915-996a-1abaa84e5b6a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:07.164912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eee5-8911-4915-996a-1abaa84e5b6a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:07.165027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eee5-8911-4915-996a-1abaa84e5b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:07.183280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ea98eee5-8911-4915-996a-1abaa84e5b6a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:07.184773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ea98eee5-8911-4915-996a-1abaa84e5b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:07.192498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:07.231558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:07.233223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:07.246020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d862-1e54-4103-a34e-8aa426f19fb0 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:07.249563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:07.250191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:07.250477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:07.250753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:07.259362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:07.260829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3f654-69a0-4b35-8155-6ce9483c0543 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:07.269943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 718/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:09.953675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e49b4-7fdd-4a5b-addb-49aa8d07785c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:09.954078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e49b4-7fdd-4a5b-addb-49aa8d07785c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:09.954222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e49b4-7fdd-4a5b-addb-49aa8d07785c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:09.956035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:09.961297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf3a5-abfc-4829-8160-d4bf189bafb3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:09.961732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf3a5-abfc-4829-8160-d4bf189bafb3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:09.961875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf3a5-abfc-4829-8160-d4bf189bafb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:09.979915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e4cbf3a5-abfc-4829-8160-d4bf189bafb3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:09.981143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e4cbf3a5-abfc-4829-8160-d4bf189bafb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:09.988963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:57:10.027343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e49b4-7fdd-4a5b-addb-49aa8d07785c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:10.038764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e49b4-7fdd-4a5b-addb-49aa8d07785c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:10.042306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:10.042935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:10.043218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:10.043516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:10.052125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:10.054182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a47b5f-fe71-477e-8b73-c754de398d68 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:10.063572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 733/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:12.469606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0954-f6d7-4b35-a675-e20a97e871ee None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:12.470144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0954-f6d7-4b35-a675-e20a97e871ee None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:12.470276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0954-f6d7-4b35-a675-e20a97e871ee None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:12.472034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:12.477287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d835-01d1-4803-8fd7-fa88de42095b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:12.477736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d835-01d1-4803-8fd7-fa88de42095b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:12.477843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d835-01d1-4803-8fd7-fa88de42095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:12.495552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ce90d835-01d1-4803-8fd7-fa88de42095b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:12.496739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ce90d835-01d1-4803-8fd7-fa88de42095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:12.504470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:12.542615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0954-f6d7-4b35-a675-e20a97e871ee None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:12.553635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf0954-f6d7-4b35-a675-e20a97e871ee None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:12.557124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:12.557751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:12.558037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:12.558315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:12.567204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:12.569324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a127-825f-4b69-9473-3173a848cf16 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:12.578381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 721/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:14.895967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8fb1-87bb-4643-b8fa-2073fcb5df3c None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:14.896506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8fb1-87bb-4643-b8fa-2073fcb5df3c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:14.896625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd8fb1-87bb-4643-b8fa-2073fcb5df3c None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:14.898362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:14.903783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41a1c-198f-407a-b451-0ba7f2b1a037 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:14.904216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41a1c-198f-407a-b451-0ba7f2b1a037 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:14.904366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41a1c-198f-407a-b451-0ba7f2b1a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:14.921532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-7df41a1c-198f-407a-b451-0ba7f2b1a037 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:14.922710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7df41a1c-198f-407a-b451-0ba7f2b1a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:14.930882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:14.969366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8fb1-87bb-4643-b8fa-2073fcb5df3c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:14.979978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd8fb1-87bb-4643-b8fa-2073fcb5df3c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:14.983496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:14.984120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:14.984406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:14.984740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:14.994137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:14.995604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5f2bf-3f38-479d-b463-d9803ed84b7a service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:15.004824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 736/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:17.343895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6909-3a61-4ed8-aad2-94ad42249f18 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:17.344407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6909-3a61-4ed8-aad2-94ad42249f18 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:17.344535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f6909-3a61-4ed8-aad2-94ad42249f18 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:17.346223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:17.352145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e41a-571c-4974-81dd-806a4ffe31f5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:17.352535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e41a-571c-4974-81dd-806a4ffe31f5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:17.352715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79e41a-571c-4974-81dd-806a4ffe31f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:17.370783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1d79e41a-571c-4974-81dd-806a4ffe31f5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:17.372019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1d79e41a-571c-4974-81dd-806a4ffe31f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:17.379781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:17.417581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6909-3a61-4ed8-aad2-94ad42249f18 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:17.428736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f6909-3a61-4ed8-aad2-94ad42249f18 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:17.432378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:17.433008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:17.433295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:17.433833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:17.442534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:17.444029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fc092-a9b6-4e0b-b032-ba65385d1540 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:17.453149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 724/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:19.778733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbd0-e1db-436d-a277-9dc1912fd24a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:19.779319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbd0-e1db-436d-a277-9dc1912fd24a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:19.779319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cbd0-e1db-436d-a277-9dc1912fd24a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:19.781102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:19.786334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09176cfc-e586-4d5b-b741-96c06a7737f2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:19.786769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09176cfc-e586-4d5b-b741-96c06a7737f2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:19.786925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09176cfc-e586-4d5b-b741-96c06a7737f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:19.804285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-09176cfc-e586-4d5b-b741-96c06a7737f2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:19.805474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-09176cfc-e586-4d5b-b741-96c06a7737f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:19.813409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:19.850569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cbd0-e1db-436d-a277-9dc1912fd24a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:19.861059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cbd0-e1db-436d-a277-9dc1912fd24a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:19.864495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:19.865118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:19.865397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:19.865670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:19.874137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:19.875586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf29f-0cb3-4f98-b7d6-923e863b88c4 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:19.885098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 739/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:22.317763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc09c-47b2-4334-815d-7bd50db713d0 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:22.318317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc09c-47b2-4334-815d-7bd50db713d0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:22.318435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc09c-47b2-4334-815d-7bd50db713d0 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:22.320219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:22.325680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917958-5e9b-4faf-bdc6-1b8fb3dc29ab None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:22.326074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917958-5e9b-4faf-bdc6-1b8fb3dc29ab None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:22.326264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917958-5e9b-4faf-bdc6-1b8fb3dc29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:22.344169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-68917958-5e9b-4faf-bdc6-1b8fb3dc29ab None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:22.345365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68917958-5e9b-4faf-bdc6-1b8fb3dc29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:22.353693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 12:57:22.389860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dc09c-47b2-4334-815d-7bd50db713d0 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:22.400811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dc09c-47b2-4334-815d-7bd50db713d0 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:22.404330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:22.404988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:22.405300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:22.405577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:22.414794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:22.416279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806aac4-5945-4bfd-bcbb-a5db57554161 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:22.425485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 727/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:24.701367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282ec9-a590-4ca9-9a95-2eacd8ecc49e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:24.701904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282ec9-a590-4ca9-9a95-2eacd8ecc49e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:24.701904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282ec9-a590-4ca9-9a95-2eacd8ecc49e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:24.703738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:24.709165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256d71-cded-4b5e-bf76-9c9b5a1ec05f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:24.709577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256d71-cded-4b5e-bf76-9c9b5a1ec05f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:24.709758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256d71-cded-4b5e-bf76-9c9b5a1ec05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:24.727141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ce256d71-cded-4b5e-bf76-9c9b5a1ec05f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:24.734461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ce256d71-cded-4b5e-bf76-9c9b5a1ec05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:24.736161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:24.773209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282ec9-a590-4ca9-9a95-2eacd8ecc49e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:24.783661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282ec9-a590-4ca9-9a95-2eacd8ecc49e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:24.787682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:24.788300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:24.788579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:24.788851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:24.797992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:24.799410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174a7e-0795-4c89-8a00-4517a444d6dc service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:24.809310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 742/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:27.077254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d968-93c7-46cf-a035-e7111ca64b37 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:27.077758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d968-93c7-46cf-a035-e7111ca64b37 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:27.077872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1d968-93c7-46cf-a035-e7111ca64b37 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:27.079657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 729/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 12:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:27.085667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4460fd-9fb7-4461-a757-0053f60656f1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:27.086087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4460fd-9fb7-4461-a757-0053f60656f1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:27.086235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4460fd-9fb7-4461-a757-0053f60656f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:27.103576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ac4460fd-9fb7-4461-a757-0053f60656f1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:27.104767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ac4460fd-9fb7-4461-a757-0053f60656f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:27.112519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 743/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:27.149174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d968-93c7-46cf-a035-e7111ca64b37 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:27.159819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1d968-93c7-46cf-a035-e7111ca64b37 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:27.163506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:27.164138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:27.164422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:27.164695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:27.173377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:27.174807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474024-554f-451b-ac1f-cf612a607c69 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:27.184102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 730/1473] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:47.678136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c5d-d5eb-4124-87ca-2995d531b0d1 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:47.678747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c5d-d5eb-4124-87ca-2995d531b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:47.678747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c5d-d5eb-4124-87ca-2995d531b0d1 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:47.680502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 744/1474] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:47.686136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25974e5-9e0f-4fcd-9f29-648046baefa8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:47.686555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25974e5-9e0f-4fcd-9f29-648046baefa8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:47.686700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25974e5-9e0f-4fcd-9f29-648046baefa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:47.704671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d25974e5-9e0f-4fcd-9f29-648046baefa8 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:47.705856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d25974e5-9e0f-4fcd-9f29-648046baefa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:47.713632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 731/1475] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:47.759372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ee97-c6f1-49a0-b2d0-5aa2a2fa677a None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:47.759704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ee97-c6f1-49a0-b2d0-5aa2a2fa677a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:47.759991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41ee97-c6f1-49a0-b2d0-5aa2a2fa677a None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:47.761786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 745/1476] 10.222.0.23 () {54 vars in 962 bytes} [Mon Feb 28 12:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:47.766263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a61ad-22aa-4fd1-aaa6-88204aaa440c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:47.766553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a61ad-22aa-4fd1-aaa6-88204aaa440c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:47.766832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a61ad-22aa-4fd1-aaa6-88204aaa440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:47.785273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9f3a61ad-22aa-4fd1-aaa6-88204aaa440c None None] MFA Rules not processed for user `b8d34ef4b64a42a897fa75e8b14c60f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:47.786446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9f3a61ad-22aa-4fd1-aaa6-88204aaa440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:47.792756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 732/1477] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Feb 28 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:47.799614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41ee97-c6f1-49a0-b2d0-5aa2a2fa677a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:47.810971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41ee97-c6f1-49a0-b2d0-5aa2a2fa677a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:47.814519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:47.815146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:47.815418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:47.815727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:47.825114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:47.826534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9540-5acd-4b9f-a540-69a7e23e29f2 service glance] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:47.836143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 746/1478] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:50.213785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84bc0-f819-4780-89b6-b2cc2bc3598d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:50.214324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84bc0-f819-4780-89b6-b2cc2bc3598d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:50.214324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e84bc0-f819-4780-89b6-b2cc2bc3598d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:50.216249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 733/1479] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:50.221367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125452b3-e394-443b-9189-c00dfa27cd4d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:50.221775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125452b3-e394-443b-9189-c00dfa27cd4d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:50.221927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125452b3-e394-443b-9189-c00dfa27cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:50.239982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-125452b3-e394-443b-9189-c00dfa27cd4d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:50.241173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-125452b3-e394-443b-9189-c00dfa27cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:50.248942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 747/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:50.272252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e84bc0-f819-4780-89b6-b2cc2bc3598d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:50.284387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e84bc0-f819-4780-89b6-b2cc2bc3598d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:50.289323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:50.291196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:50.291196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:50.291196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:50.291196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:50.293007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:57:50.293007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 12:57:50.293007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 12:57:50.294136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7712e9a-c366-4b50-9cc8-4e94dbe818df admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:50.312675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 734/1481] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Feb 28 12:57:50 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:57:52.604490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0c3c-8a9e-4694-96fd-e6e3631023e2 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:52.605071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0c3c-8a9e-4694-96fd-e6e3631023e2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:52.605071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0c3c-8a9e-4694-96fd-e6e3631023e2 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:52.606836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 748/1482] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:52.612128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6128369-5c77-4eec-bc93-b11295a6c44d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:52.612519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6128369-5c77-4eec-bc93-b11295a6c44d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:52.612688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6128369-5c77-4eec-bc93-b11295a6c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:52.629545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a6128369-5c77-4eec-bc93-b11295a6c44d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:52.631267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a6128369-5c77-4eec-bc93-b11295a6c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:52.639197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 735/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:52.680251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a0c3c-8a9e-4694-96fd-e6e3631023e2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:52.695375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a0c3c-8a9e-4694-96fd-e6e3631023e2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:52.700623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:52.701242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:52.701522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:52.701798 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:52.710120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:52.711712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344de7a7-085a-4a39-82d9-7d98e355dd5e service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:52.720654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 749/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:55.179770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf13f57-1899-4938-819f-14bff914ed0f None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:55.180307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf13f57-1899-4938-819f-14bff914ed0f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:55.180420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf13f57-1899-4938-819f-14bff914ed0f None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:55.182401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 736/1485] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:55.187985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bd96-cdec-48ad-a36c-a821bf647e10 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:55.188393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bd96-cdec-48ad-a36c-a821bf647e10 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:55.188594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bd96-cdec-48ad-a36c-a821bf647e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:55.207131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b300bd96-cdec-48ad-a36c-a821bf647e10 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:55.208812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b300bd96-cdec-48ad-a36c-a821bf647e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:55.217163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 750/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:55.253580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf13f57-1899-4938-819f-14bff914ed0f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:55.265822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf13f57-1899-4938-819f-14bff914ed0f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:55.269492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:55.270179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:55.270498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:55.270778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:55.279906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:55.281431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f1431-feeb-45bc-a39a-632de115bc4c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:55.290701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 737/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:57:57.594967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c9e9-3b82-45fc-9582-055978070e24 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:57.595585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c9e9-3b82-45fc-9582-055978070e24 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:57.595585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c9e9-3b82-45fc-9582-055978070e24 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:57.597308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 751/1488] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:57:57.602472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87141-d1e1-4369-a3d7-1f45c151f888 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:57.602850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87141-d1e1-4369-a3d7-1f45c151f888 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:57.603028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87141-d1e1-4369-a3d7-1f45c151f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:57.621286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-cca87141-d1e1-4369-a3d7-1f45c151f888 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:57:57.622476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cca87141-d1e1-4369-a3d7-1f45c151f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:57:57.631048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 738/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:57:57.667241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c9e9-3b82-45fc-9582-055978070e24 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:57:57.678133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c9e9-3b82-45fc-9582-055978070e24 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:57:57.681655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:57:57.682275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:57:57.682558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:57:57.683090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:57:57.691743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:57:57.693769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490c18-4b9e-40ad-9baf-78bf8b8ebe18 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:57:57.702987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 752/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:58:00.069018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3728-eff0-4e08-b64f-2d3ac072e5bd None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:00.069435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3728-eff0-4e08-b64f-2d3ac072e5bd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:00.069579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c3728-eff0-4e08-b64f-2d3ac072e5bd None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:00.071357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 739/1491] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:58:00.076583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ef14-e953-4292-a39c-cb009bf38ceb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:00.076978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ef14-e953-4292-a39c-cb009bf38ceb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:00.077145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758ef14-e953-4292-a39c-cb009bf38ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:00.094455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0758ef14-e953-4292-a39c-cb009bf38ceb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:58:00.095656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0758ef14-e953-4292-a39c-cb009bf38ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:58:00.103824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 753/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:58:00.143290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c3728-eff0-4e08-b64f-2d3ac072e5bd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:58:00.153812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c3728-eff0-4e08-b64f-2d3ac072e5bd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:58:00.157360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:58:00.157984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:00.158263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:00.158535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:00.167690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:58:00.169109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de765d23-45cf-4585-995f-83be256b8a2c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:58:00.178705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 740/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:58:02.761675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08273af-2799-440c-bb5d-c5481dbff409 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:02.762214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08273af-2799-440c-bb5d-c5481dbff409 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:02.762310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08273af-2799-440c-bb5d-c5481dbff409 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:02.764049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 754/1494] 10.222.0.23 () {54 vars in 926 bytes} [Mon Feb 28 12:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:58:02.769327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b50ce-7a1a-403a-b065-5d88a0905c8d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:02.769730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b50ce-7a1a-403a-b065-5d88a0905c8d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:02.769891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b50ce-7a1a-403a-b065-5d88a0905c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:02.787121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-de8b50ce-7a1a-403a-b065-5d88a0905c8d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:58:02.788376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-de8b50ce-7a1a-403a-b065-5d88a0905c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:58:02.796090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 741/1495] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Feb 28 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:58:02.835205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08273af-2799-440c-bb5d-c5481dbff409 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:58:02.845457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08273af-2799-440c-bb5d-c5481dbff409 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:58:02.848896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:58:02.849510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:58:02.849791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:58:02.850064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:58:02.858514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:58:02.859961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3f46-d9b2-41fa-8996-751437308531 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:58:02.869398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 755/1496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:59:32.967952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:32.968401 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:32.968507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:32.986196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:59:32.987430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:32.995764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 742/1497] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:59:33.005665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.006128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.006230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.023541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:59:33.024729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:33.032438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 756/1498] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:59:33.037320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.046613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172a4e-8da2-4932-afa1-722d642ee976 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.051698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.052339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.052619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.052892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.053606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 12:59:33.053907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.054916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.054916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 12:59:33.054916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 12:59:33.055817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.066947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 743/1499] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 12:59:33.074529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.083515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b18f69-bee6-4e15-b539-76de249b88c2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.088068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.088700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.088983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.089259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.089938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.090942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.090942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 12:59:33.090942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 12:59:33.092198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.204396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 757/1500] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 12:59:33 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:59:33.208420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.217916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c10ab0-4d94-415d-928f-af70778c576f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.270348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.271079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.271366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.271676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.272356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.273371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.273371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 12:59:33.273371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 12:59:33.274574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.334927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 744/1501] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 12:59:33 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 12:59:33.339011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.349773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f9b6-3b50-4caf-b5da-0c8ad97da425 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.354324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.354973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.355255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.355560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.356274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.357280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.357280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 12:59:33.357280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 12:59:33.358203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.371917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 758/1502] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 12:59:33.375810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.385477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de22cf-7756-4108-b41d-fbcc1d983634 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.389996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.390646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.390942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.391216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.391969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.392986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.392986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 12:59:33.392986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 12:59:33.393873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db83b2-5253-4ec6-9384-119f0bd6325f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.407297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 745/1503] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 12:59:33.411970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.421491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f46f6-9f71-462f-aaac-0a4e431a71de admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.425902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.426785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.427065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.427342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] PATH_INFO: `/v3/projects/dee98b6da0b84224998046f3da77ba4a/users/27e7864a636e4e0db3a7ea9654c06244/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.441428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee98b6da0b84224998046f3da77ba4a, user_id=27e7864a636e4e0db3a7ea9654c06244, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.442457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.442457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 12:59:33.442457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 12:59:33.444394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.500488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 759/1504] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 12:59:33 2022] PUT /identity/v3/projects/dee98b6da0b84224998046f3da77ba4a/users/27e7864a636e4e0db3a7ea9654c06244/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 12:59:33.511782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412376d4-0693-4a55-b658-d58053251fe3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.512073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412376d4-0693-4a55-b658-d58053251fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.512354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412376d4-0693-4a55-b658-d58053251fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.538343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-412376d4-0693-4a55-b658-d58053251fe3 None None] MFA Rules not processed for user `27e7864a636e4e0db3a7ea9654c06244`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:59:33.539568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-412376d4-0693-4a55-b658-d58053251fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:33.599129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 746/1505] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:59:33.610063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.676704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e90a8-44b3-4a08-a767-1522a61012f1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.682346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.682979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.683267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.683586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.691010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.692662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:33.701084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 760/1506] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:59:33.772290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68544e-7d9f-4bfa-8a32-4bb6fe07cf53 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.772582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68544e-7d9f-4bfa-8a32-4bb6fe07cf53 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.772863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68544e-7d9f-4bfa-8a32-4bb6fe07cf53 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.774548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 747/1507] 10.222.0.23 () {52 vars in 829 bytes} [Mon Feb 28 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 12:59:33.778063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:33.837872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ad97-b437-44fd-94b0-dc41fe3ded6d service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:33.842488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:33.843338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:33.843657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:33.843940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] PATH_INFO: `/v3/users/27e7864a636e4e0db3a7ea9654c06244` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:33.845112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e7864a636e4e0db3a7ea9654c06244)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:33.846129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:33.846129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 12:59:33.846129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 12:59:33.847330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:34.009481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e7864a636e4e0db3a7ea9654c06244'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:34.010083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e7864a636e4e0db3a7ea9654c06244'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:34.010715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e7864a636e4e0db3a7ea9654c06244'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:34.089086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e7864a636e4e0db3a7ea9654c06244'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:34.107055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e7864a636e4e0db3a7ea9654c06244'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:34.124930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 761/1508] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 12:59:33 2022] DELETE /identity/v3/users/27e7864a636e4e0db3a7ea9654c06244 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 12:59:34.129885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:34.130331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:34.130442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:34.147236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 12:59:34.148455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:34.203811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 748/1509] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 12:59:34.213276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:34.214632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:34.268506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d52577-bb04-42ea-b786-b4ad25e6ee06 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:34.272053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:34.272691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:34.272974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:34.273254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:34.281899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:34.283335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45572b-c00f-4d06-97c3-9d2e253e878e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:34.292370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 762/1510] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 12:59:34.777004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 12:59:34.779926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 12:59:34.790822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938b4c6-22a5-4725-b099-26948a143afa None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 12:59:34.795485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 12:59:34.796441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 12:59:34.796725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 12:59:34.797000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] PATH_INFO: `/v3/projects/dee98b6da0b84224998046f3da77ba4a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 12:59:34.798204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee98b6da0b84224998046f3da77ba4a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 12:59:34.799242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 12:59:34.799242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 12:59:34.799242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 12:59:34.800470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 12:59:34.946371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee98b6da0b84224998046f3da77ba4a', 'request_id': 'req-abe4fa85-1247-4f1a-adb1-5ee774392423'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:35.032569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee98b6da0b84224998046f3da77ba4a', 'request_id': 'req-abe4fa85-1247-4f1a-adb1-5ee774392423'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:35.039454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee98b6da0b84224998046f3da77ba4a', 'request_id': 'req-abe4fa85-1247-4f1a-adb1-5ee774392423'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:35.058083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] The token cache is being invalidate because project dee98b6da0b84224998046f3da77ba4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 12:59:35.058403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:35.059150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-abe4fa85-1247-4f1a-adb1-5ee774392423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 12:59:35.060713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 749/1511] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 12:59:34 2022] DELETE /identity/v3/projects/dee98b6da0b84224998046f3da77ba4a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:01:11.962446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:11.962965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:11.963074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:11.964796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 763/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 13:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:11.969657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324ac6-a20c-4531-a1ba-aae76586b1f3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:11.970089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324ac6-a20c-4531-a1ba-aae76586b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:11.970220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324ac6-a20c-4531-a1ba-aae76586b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:11.988019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8a324ac6-a20c-4531-a1ba-aae76586b1f3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:11.989290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8a324ac6-a20c-4531-a1ba-aae76586b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:12.045607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 750/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:12.202714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:12.204439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:12.276861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3547-7cdf-44ab-96f9-628b816292f7 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:12.282223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:12.282846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:12.283127 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:12.283403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:12.291203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:12.292851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd8d84-cdaa-4729-976f-2d8501f7db45 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:12.302454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 764/1514] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:12.839441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac1b-1732-492d-9505-8f51aab847cf None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:12.839778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac1b-1732-492d-9505-8f51aab847cf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:12.840063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ac1b-1732-492d-9505-8f51aab847cf None None] PATH_INFO: `/v3` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:12.841400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 751/1515] 10.222.0.35 () {54 vars in 925 bytes} [Mon Feb 28 13:01:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:01:12.847740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbf6a-cd79-4248-bfd4-76d974e950d3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:12.848121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbf6a-cd79-4248-bfd4-76d974e950d3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:12.848466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dbf6a-cd79-4248-bfd4-76d974e950d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:12.866451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-224dbf6a-cd79-4248-bfd4-76d974e950d3 None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:12.867693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-224dbf6a-cd79-4248-bfd4-76d974e950d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:12.926567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 765/1516] 10.222.0.35 () {58 vars in 1015 bytes} [Mon Feb 28 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:01:13.582316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65c0f-af64-4bcc-b758-3c671750702d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:13.582887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65c0f-af64-4bcc-b758-3c671750702d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:13.582887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a65c0f-af64-4bcc-b758-3c671750702d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:13.584657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 752/1517] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 13:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:13.589436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03a8d-6ecc-4942-b25a-323fa2215489 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:13.589835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03a8d-6ecc-4942-b25a-323fa2215489 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:13.590000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03a8d-6ecc-4942-b25a-323fa2215489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:13.608016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-05e03a8d-6ecc-4942-b25a-323fa2215489 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:13.609197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-05e03a8d-6ecc-4942-b25a-323fa2215489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:13.617387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 766/1518] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:13.768264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a65c0f-af64-4bcc-b758-3c671750702d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:13.782359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a65c0f-af64-4bcc-b758-3c671750702d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:13.788452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:13.789084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:13.789371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:13.789653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:13.797881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:13.799497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcf750-2e62-48ac-91a9-777e8cd7253a service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:13.809870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 753/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:17.120868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a47038-ebec-45dc-89c5-8e7e250f4e9e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:17.121418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a47038-ebec-45dc-89c5-8e7e250f4e9e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:17.121418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a47038-ebec-45dc-89c5-8e7e250f4e9e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:17.123222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 767/1520] 10.222.0.23 () {54 vars in 960 bytes} [Mon Feb 28 13:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:17.128557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201ce3-0537-425d-9169-143e1428e75d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:17.129005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201ce3-0537-425d-9169-143e1428e75d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:17.129110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4201ce3-0537-425d-9169-143e1428e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:17.147170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b4201ce3-0537-425d-9169-143e1428e75d None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:17.148383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b4201ce3-0537-425d-9169-143e1428e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:17.156570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 754/1521] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Feb 28 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:17.164338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a47038-ebec-45dc-89c5-8e7e250f4e9e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:17.177434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a47038-ebec-45dc-89c5-8e7e250f4e9e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:17.182516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:17.183147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:17.183433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:17.183747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:17.192199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:17.193821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed57fa-6136-4a8d-ad5d-cc253fa85775 service placement] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:17.203567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 768/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:25.489605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aff8b0-b1bd-4358-b57a-cf9fd6e5198b None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:25.490199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aff8b0-b1bd-4358-b57a-cf9fd6e5198b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:25.490199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aff8b0-b1bd-4358-b57a-cf9fd6e5198b None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:25.492029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 13:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:25.496862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660dfc-7c9f-47e0-910c-82b8f5e36bae None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:25.497293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660dfc-7c9f-47e0-910c-82b8f5e36bae None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:25.497414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660dfc-7c9f-47e0-910c-82b8f5e36bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:25.515255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-04660dfc-7c9f-47e0-910c-82b8f5e36bae None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:25.516492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-04660dfc-7c9f-47e0-910c-82b8f5e36bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:25.524866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:25.676062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aff8b0-b1bd-4358-b57a-cf9fd6e5198b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:25.690212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aff8b0-b1bd-4358-b57a-cf9fd6e5198b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:25.696003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:25.696628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:25.696910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:25.697185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:25.705001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:25.706587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd3c6-3532-49e3-bfb5-29be8090ace5 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:25.716177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 756/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:26.969050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121fcc-37fa-432e-a636-90836a3fee38 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:26.969518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121fcc-37fa-432e-a636-90836a3fee38 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:26.969645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df121fcc-37fa-432e-a636-90836a3fee38 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:26.971479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 13:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:26.976839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aefdd-a5c2-4a0a-aade-bd6fa320dd88 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:26.977261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aefdd-a5c2-4a0a-aade-bd6fa320dd88 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:26.977374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aefdd-a5c2-4a0a-aade-bd6fa320dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:26.995392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-da3aefdd-a5c2-4a0a-aade-bd6fa320dd88 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:26.996597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-da3aefdd-a5c2-4a0a-aade-bd6fa320dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:27.004266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:27.153686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121fcc-37fa-432e-a636-90836a3fee38 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:27.168272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df121fcc-37fa-432e-a636-90836a3fee38 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:27.173772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:27.174402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:27.174686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:27.174962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:27.183902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:27.185497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd45ac3-bff1-402b-b961-4f5f0014496c service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:27.194509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 771/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:31.563796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:31.564363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:31.564363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:31.566146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 13:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:31.571954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43424e-781e-4d68-a4e5-29c09add60ce None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:31.572362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43424e-781e-4d68-a4e5-29c09add60ce None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:31.572536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43424e-781e-4d68-a4e5-29c09add60ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:31.593004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1d43424e-781e-4d68-a4e5-29c09add60ce None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:31.594218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1d43424e-781e-4d68-a4e5-29c09add60ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:31.602008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:31.637792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:31.639436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:31.694288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf5b3-f5bc-42cb-b508-24371eec2b6d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:31.697753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:31.698383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:31.698663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:31.698938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:31.707512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:31.709481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca34c15-5e94-44b5-a8fe-0304090d44dc service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:31.718439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 759/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:33.978124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:33.978556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:33.978664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:33.980501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 13:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:33.985581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f538-abc6-4887-917e-48503fc06eb9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:33.985973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f538-abc6-4887-917e-48503fc06eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:33.986143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f538-abc6-4887-917e-48503fc06eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:34.003834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c5d1f538-abc6-4887-917e-48503fc06eb9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:34.005586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c5d1f538-abc6-4887-917e-48503fc06eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:34.013281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:34.049466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:34.051130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:34.064643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cc90a-3674-4e30-8417-dc7bd87dbcc9 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:34.068802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:34.069424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:34.069704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:34.069979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:34.078818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:34.080253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38fdf6-702b-4076-9a5e-b608b709ce25 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:34.089191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 774/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:37.955701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:37.956232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:37.956336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:37.958051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 13:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 13:01:37.963377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b609f4-b787-4183-a91a-3ef748ec9dd5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:37.963845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b609f4-b787-4183-a91a-3ef748ec9dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:37.963997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b609f4-b787-4183-a91a-3ef748ec9dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:37.981572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e6b609f4-b787-4183-a91a-3ef748ec9dd5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:37.982794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e6b609f4-b787-4183-a91a-3ef748ec9dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:37.991343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:38.246631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:38.248300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:38.304176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac8d7-122b-484c-a2e1-489aecced5c2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:38.307673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:38.308302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:38.308584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:38.308927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:38.318117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:38.319657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc65fe-bf90-4ffd-b041-695e780bf4fb service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:38.328668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 762/1537] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:01:40.623025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018616-4e5e-4814-b756-1abb14899c51 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:40.623594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018616-4e5e-4814-b756-1abb14899c51 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:40.623707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01018616-4e5e-4814-b756-1abb14899c51 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:40.625460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 776/1538] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 13:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:40.630549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069899fe-0b20-4191-b0e9-71888d42ccfd None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:40.630951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069899fe-0b20-4191-b0e9-71888d42ccfd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:40.631100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069899fe-0b20-4191-b0e9-71888d42ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:40.649028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-069899fe-0b20-4191-b0e9-71888d42ccfd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:40.650234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-069899fe-0b20-4191-b0e9-71888d42ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:40.657924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 763/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:40.909700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666e3b-06c8-4716-8f44-258434172c88 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:40.909985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666e3b-06c8-4716-8f44-258434172c88 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:40.910262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666e3b-06c8-4716-8f44-258434172c88 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:40.912719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 777/1540] 10.222.0.23 () {54 vars in 963 bytes} [Mon Feb 28 13:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:01:40.917635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6021-3588-4f15-8929-566dcd2e4bd5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:40.917926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6021-3588-4f15-8929-566dcd2e4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:40.918205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6021-3588-4f15-8929-566dcd2e4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:40.936030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1ddb6021-3588-4f15-8929-566dcd2e4bd5 None None] MFA Rules not processed for user `6793eba624e644a9ba49910428cdb515`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:01:40.937190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1ddb6021-3588-4f15-8929-566dcd2e4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:01:40.943523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 764/1541] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Feb 28 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:01:40.950805 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43666e3b-06c8-4716-8f44-258434172c88 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:01:40.961759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43666e3b-06c8-4716-8f44-258434172c88 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:01:40.965271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:01:40.965888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:01:40.966171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:01:40.966448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:01:40.975690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:01:40.977110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d90e6-42d0-4144-8600-9cd8cc722cc0 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:01:40.986150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 778/1542] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:11.005050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b1c6-2f6f-443b-889a-447b75aac4ef None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.005742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b1c6-2f6f-443b-889a-447b75aac4ef None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.005742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b1c6-2f6f-443b-889a-447b75aac4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.030637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-62f3b1c6-2f6f-443b-889a-447b75aac4ef None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.031893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-62f3b1c6-2f6f-443b-889a-447b75aac4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.044685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 765/1543] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.047158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fe3b-87f1-4bff-83b2-091c4ddd5108 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.047695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fe3b-87f1-4bff-83b2-091c4ddd5108 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.047788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fe3b-87f1-4bff-83b2-091c4ddd5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.053412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.053707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.054005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.084756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3cc4fe3b-87f1-4bff-83b2-091c4ddd5108 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.085181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.086018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3cc4fe3b-87f1-4bff-83b2-091c4ddd5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.086381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.095557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 779/1544] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:11.101258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 766/1545] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.104247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.104539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.105047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.105681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.120382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe3ba-dfc7-4b54-a353-0cda19004db6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.130184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.131956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.132192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.132835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.133121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.133399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.134125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.134430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.136087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.145942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 780/1546] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.152426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.165841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c10f8f-34aa-4d4c-b2dc-39db8ff1e29e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.166313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 767/1547] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:03:11.174090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.175631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.176298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.176852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.177131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.177890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.178201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.179237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:11.179237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 13:03:11.179237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 13:03:11.180165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.204874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 781/1548] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.205908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f641-1afa-4f11-bd2c-de03724a9dc3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.213669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.216282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.216986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.217283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.217573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.218306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.219382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:11.219382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 13:03:11.219382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 13:03:11.220641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.229083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba3748-7443-42b0-8d7b-4a22c2a8fb76 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.256911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.261322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.261322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.261322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.261322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.261322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bfe9-fb08-433f-a2b4-64e26a123023 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.369475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 768/1549] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:11.373460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.464713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343182-b78d-41f7-b8f6-92315abaf0db admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.472223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.474017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.474017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.474017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.474294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 782/1550] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:11.474670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.475131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bac9-4d2b-47cb-9f09-9f138ed1cc90 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.475429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bac9-4d2b-47cb-9f09-9f138ed1cc90 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.475740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04bac9-4d2b-47cb-9f09-9f138ed1cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.476889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.514742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4f04bac9-4d2b-47cb-9f09-9f138ed1cc90 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.516070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4f04bac9-4d2b-47cb-9f09-9f138ed1cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.576211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 783/1551] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.578016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4987-acb3-4d3b-850c-198deb80fcc9 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.578389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4987-acb3-4d3b-850c-198deb80fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.578746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4987-acb3-4d3b-850c-198deb80fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.592986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 769/1552] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:11.593202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.597433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d18d4987-acb3-4d3b-850c-198deb80fcc9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.598665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d18d4987-acb3-4d3b-850c-198deb80fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.604433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd282-d3b5-4a32-af39-fa09e72b5c0a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.606626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 784/1553] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.607971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fca69-d0cb-4be4-956a-c2438c22de17 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.608269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fca69-d0cb-4be4-956a-c2438c22de17 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.608550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fca69-d0cb-4be4-956a-c2438c22de17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.609974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.610613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.610896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.611170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.611889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.613962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946a668-7a8d-4499-8b53-57228ef0b164 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.627864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-aa2fca69-d0cb-4be4-956a-c2438c22de17 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.631601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa2fca69-d0cb-4be4-956a-c2438c22de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.637705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 785/1554] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.638907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6e09-bc42-45b5-b9d4-07f180a1c677 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.639202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6e09-bc42-45b5-b9d4-07f180a1c677 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.639509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6e09-bc42-45b5-b9d4-07f180a1c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.657319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a40d6e09-bc42-45b5-b9d4-07f180a1c677 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.658482 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a40d6e09-bc42-45b5-b9d4-07f180a1c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.667001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 786/1555] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.668209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987456-46ba-4f4f-a4d5-f61ca63c395b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.668503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987456-46ba-4f4f-a4d5-f61ca63c395b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.668789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987456-46ba-4f4f-a4d5-f61ca63c395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.687120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ed987456-46ba-4f4f-a4d5-f61ca63c395b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.688311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ed987456-46ba-4f4f-a4d5-f61ca63c395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.696238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 787/1556] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.697430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.697719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.698000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.703565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 770/1557] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:11.703565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a746-f714-45ca-8db4-256e626ad204 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.703565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a746-f714-45ca-8db4-256e626ad204 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.703565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a746-f714-45ca-8db4-256e626ad204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.720021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.720478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-efe7a746-f714-45ca-8db4-256e626ad204 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.721247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.721639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-efe7a746-f714-45ca-8db4-256e626ad204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.729751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 788/1558] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.730485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 771/1559] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.730616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.735508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3e467-af64-4d6e-9783-97ecbd5dfb7c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.735508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3e467-af64-4d6e-9783-97ecbd5dfb7c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.735508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3e467-af64-4d6e-9783-97ecbd5dfb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.740842 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdaf8b0-11c8-4365-90e4-8cda9fde40cd None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.745364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.746000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.746289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.746564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.747279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.748932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03ef1-305d-44cb-9b9d-dc2a832500d0 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.751003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-92e3e467-af64-4d6e-9783-97ecbd5dfb7c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.752308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-92e3e467-af64-4d6e-9783-97ecbd5dfb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.758959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 789/1560] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:11.760258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.760551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.760829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.763373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 772/1561] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.764650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a494ce-30d3-431a-8d89-7c5704209ca2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.764944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a494ce-30d3-431a-8d89-7c5704209ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.765222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a494ce-30d3-431a-8d89-7c5704209ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.779621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.780810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.782704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-44a494ce-30d3-431a-8d89-7c5704209ca2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.783873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-44a494ce-30d3-431a-8d89-7c5704209ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.789197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 790/1562] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.790011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.792460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 773/1563] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.796875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6918-30b7-4174-a111-44678f9fb4fa None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.797166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6918-30b7-4174-a111-44678f9fb4fa None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.797445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6918-30b7-4174-a111-44678f9fb4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.799292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44905e48-7c1a-4352-8692-9d103f96d5c2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.804069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.804703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.804982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.805256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.805987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.807632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.816863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-165a6918-30b7-4174-a111-44678f9fb4fa None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.817109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 791/1564] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:11.831709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.831839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-165a6918-30b7-4174-a111-44678f9fb4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.831839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 774/1565] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.832037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43229-74ea-4a3e-bb33-30bb5e13596e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.832140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.832140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.832140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.833400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.834612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.834892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.835162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.835918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.836220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.837799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.846756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:11.847974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:11.849428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 792/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.850384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.861415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 775/1567] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:11.862468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.864803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f1c8-5ec8-4c5f-88de-e364195aee33 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.869342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.869976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.870299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.870582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.871283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.872041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af37ea-8862-44b2-8353-f1a6638972c1 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.872944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.876515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.877172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.877457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.877745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.878464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.878774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.880398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.883161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 793/1568] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:11.884014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.899934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 776/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.900152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c6a-ed1e-4e61-b4aa-844bc7096548 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.900275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.900387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.900387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.900387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.900387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.900736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.900885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.902468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.903046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a19-bbbf-43b3-b609-ad12e392054a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.907677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.908311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.908598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.908928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.909642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.909952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.911557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.918274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 794/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.918274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.923343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 777/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.924222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.924426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b56be-0b93-4f3b-80fa-5badfe6bb0bb admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.929444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.930399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.930399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.930701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.931428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.933167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.933825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eef56-5a27-4f17-8eb5-165906928933 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.938481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.939111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.939447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.939757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.940455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.940876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.942788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.947053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 795/1572] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:11.947053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.954517 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154afdea-aacb-47a9-a02d-ad2b4a16c8c9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.955404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 778/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.956122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.959880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.960518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.960804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.961084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.961768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.964059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.967555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff37ef7-b136-4bf8-917b-8a15e009b82b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:11.972186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:11.972758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:11.973038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:11.973311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:11.974011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:11.974312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:11.975942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:11.987526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 779/1574] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:11.993662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:11.997537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca930f-4dbe-4a92-8d65-376f010beb57 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.002364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.003226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.003540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.003823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] PATH_INFO: `/v3/projects/3c22aa8aca9d45969301f160ec25cc4e/users/aa94fa12c3e84c55a21626c44ad8ba9a/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.018057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c22aa8aca9d45969301f160ec25cc4e, user_id=aa94fa12c3e84c55a21626c44ad8ba9a, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.019088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:12.019088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 13:03:12.019088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 13:03:12.021089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.067908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 796/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:11 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.069238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.083455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 780/1576] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:11 2022] PUT /identity/v3/projects/3c22aa8aca9d45969301f160ec25cc4e/users/aa94fa12c3e84c55a21626c44ad8ba9a/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:12.085029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.129943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fecf7-1934-4f55-88ba-8b216c5b9d48 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.145285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615e02b-08f6-4060-8106-ebf3ad6481c0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.150515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.151165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.151447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.151750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.152428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.154366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.184610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.185269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.185553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.185832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.186522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.188464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.220660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 781/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.221662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.262809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 797/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.266741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.281682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480853-9f40-4b78-9299-127990c8884d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.325298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e806446-ec2f-453c-ac5d-a57487a84aa3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.329979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.330852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.331135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.331412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] PATH_INFO: `/v3/projects/24004d6c21a74639aae97880bd275bf2/users/6324b4a3b7af4af2a1e598f8089853b6/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.335812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.336607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.337003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.337415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.338253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.340357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.345195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24004d6c21a74639aae97880bd275bf2, user_id=6324b4a3b7af4af2a1e598f8089853b6, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.347884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.403007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 798/1579] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:12 2022] PUT /identity/v3/projects/24004d6c21a74639aae97880bd275bf2/users/6324b4a3b7af4af2a1e598f8089853b6/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:12.403826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.410424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 782/1580] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.411345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.466381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502176f-2fbc-49fd-a749-a7c1e1847b86 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.469748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b878be-55af-45d6-94b6-78b9187119f0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.470923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.471608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.471893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.472169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.472900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.474359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.474788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.475005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.475290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.475611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.476295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.478196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5db82-f377-4825-8fcd-9ab5ea489d17 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.550894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 799/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.550894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.554423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 783/1582] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.555804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.558459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.558459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.583828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] MFA Rules not processed for user `aa94fa12c3e84c55a21626c44ad8ba9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:12.584971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:12.609592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab0928-3572-4e81-94b8-2c87e82e9001 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.647645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 784/1583] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:12.648547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.668355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.669174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.669557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.669940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.670725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.671869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:12.671869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 13:03:12.671869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 13:03:12.673308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.709473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9837bf-acd7-495d-91a9-f22318f88850 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.713870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.714524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.714878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.715159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.715918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.717899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cbe3-1df1-400d-b80e-79e76e95ece5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.763870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 800/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.764603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.773777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9a1b-9ec2-4c3b-b7c1-c821130c598b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.778543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.779179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.779486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.779772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.780443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.782360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.831487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 785/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.832928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.833244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.833523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.850626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:12.851839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:12.854898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 801/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.855643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.859762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 786/1587] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:12.860556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.868717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4942bf-6b65-4b26-a44d-72e273bd4929 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.871037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a0ec3-d540-4d29-a62e-e390f3005d69 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.873848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.874508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.874794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.875198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.875919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.876071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.876625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.876937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.877215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.877894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.878025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.879857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e740f-36c9-4422-8847-d34e61df75b3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.963665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 802/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.964729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.972995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 787/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:12.972995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820758-4cb9-4e29-a761-dd4f4ecedc47 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.972995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820758-4cb9-4e29-a761-dd4f4ecedc47 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.972995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820758-4cb9-4e29-a761-dd4f4ecedc47 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.973606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 788/1590] 10.222.0.23 () {54 vars in 961 bytes} [Mon Feb 28 13:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:12.974407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820758-4cb9-4e29-a761-dd4f4ecedc47 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:12.976630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615b12-d700-465d-81f0-3ad30e486668 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.981131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.982020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.984100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.984100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.984100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:12.985196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:12.987205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820758-4cb9-4e29-a761-dd4f4ecedc47 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:12.996492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:12.997152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:12.997439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:12.997718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:12.998443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.000093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.010189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 789/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.010957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.019977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473cc6b-ba9b-4886-a389-7a8ffe0662d5 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.024922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.025607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.025805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.026083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.026775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.028337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.038736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 790/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.039495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.048390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd4804-89ae-451c-bf44-e4c7c93c22b1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.053191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.053807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.073302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.073302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.073302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.073655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 803/1593] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:12 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:13.073655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.074132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.074132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 791/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.074132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.076354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c83d3-d78d-44e1-b379-9983bc0a67d8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.081041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.081684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.081970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.082255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.082971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.085161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.094804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 792/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.095613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.105602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b6e90-f78f-4c7f-a433-5c75b85aa15c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.110918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.111608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.111897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.112177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.112895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.114341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e818773-cc94-48e5-8b77-cb05da070d4e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.114474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103857-a97f-4c52-b44e-f1d4b73c3269 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.117988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.118626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.118916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.119193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.124750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 793/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.126181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.126470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.126744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.128670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.130109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.139588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 804/1597] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:13.140235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.143826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:13.145777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:13.149685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ef4bd-03d0-4dff-be4f-47a34e7521f9 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.155252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.155932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.156218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.156494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.157193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.158790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.169204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 805/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.170012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.179955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de988-70ab-4838-b5dd-73c610f7f02b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.184492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.185135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.185429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.185705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.186416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.188025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.197783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 806/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.198676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.208321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975848e-156c-4039-8804-95bee2c99b04 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.213569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.214320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.216590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 794/1600] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Feb 28 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:13.216714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.216714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.216885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.217006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.217118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.225402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02424a2f-593e-41e7-a164-41d1cd3eb999 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.228410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 807/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.229116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.230051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.230801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.231035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.231403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.232167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.233779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.243816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 795/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.244069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824730-0d02-4938-b01a-20c378f44f4d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.245996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.249351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.250062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.250686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.250686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.251661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.253403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.257422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083168-affe-411e-99e5-158f908874f6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.262408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.263079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.263363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.263673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.267350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 808/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.267528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.267630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.267741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.279643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3e8a-e5b5-4b56-b9d8-24eb4d07723c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.279814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 796/1604] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.279814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.284280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.285170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.285438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.285715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] PATH_INFO: `/v3/projects/a514bc8f2c964d85b7aa365400763653/users/69b4c5f51c5943ef95fd751c67d2e901/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.290192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e67a-747e-4156-8283-da09250cf3c6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.295103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.296222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.302148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.302148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] PATH_INFO: `/v3/projects/07d68bed67d94a8b8444e458057e60e4/users/7d58150b0d994ef5b9e2f45af9d79440/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.303380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a514bc8f2c964d85b7aa365400763653, user_id=69b4c5f51c5943ef95fd751c67d2e901, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.306180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.317055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d68bed67d94a8b8444e458057e60e4, user_id=7d58150b0d994ef5b9e2f45af9d79440, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.320314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.375044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 809/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/a514bc8f2c964d85b7aa365400763653/users/69b4c5f51c5943ef95fd751c67d2e901/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:13.378894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.406834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 797/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/07d68bed67d94a8b8444e458057e60e4/users/7d58150b0d994ef5b9e2f45af9d79440/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:13.408071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.460038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c520-b01c-4cd0-b27d-8215c5cf61eb admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.488258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3364-44d6-4121-9835-18c950b51acd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.493565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.494595 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.494971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.495443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] PATH_INFO: `/v3/projects/952b158d76784d6dbabdcca7e317913d/users/0fe4db405646440db99f2186dcd205f5/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.513102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952b158d76784d6dbabdcca7e317913d, user_id=0fe4db405646440db99f2186dcd205f5, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.516896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.529625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.530322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.530591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.530834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.583414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.585627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.594379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 810/1607] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:13.595292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.620885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e8c-927b-48ed-b59d-b3c247f3abb0 service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.621430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 798/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/952b158d76784d6dbabdcca7e317913d/users/0fe4db405646440db99f2186dcd205f5/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:13.622720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.717987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7413-56d7-4a1c-aadc-a7ae9974d546 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.720016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.722046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.722685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.723222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.724894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.727167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.731113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.732329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.735562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.736072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] PATH_INFO: `/v3/projects/1115acdea29c4ee7b98f638847770918/users/b511a97f2c9e4197afc9f57ac2f081b0/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.745804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 811/1609] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:13.747005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.756402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1115acdea29c4ee7b98f638847770918, user_id=b511a97f2c9e4197afc9f57ac2f081b0, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.758852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66aaef-1a5d-4714-b94b-e356c637f704 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:13.760229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669a9fb-ac1f-484c-be7b-905ae798fc89 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.765217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:13.766594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.766885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.767363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] PATH_INFO: `/v3/projects/d5b8923fbdc54938aa80a75bc0d7d6d5/users/0a571e4eeb5446ee9cb606a0c4e83c7d/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.786133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b8923fbdc54938aa80a75bc0d7d6d5, user_id=0a571e4eeb5446ee9cb606a0c4e83c7d, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:13.788057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b591b07-76a7-448e-a760-71b4e8a9049a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:13.833194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 799/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/1115acdea29c4ee7b98f638847770918/users/b511a97f2c9e4197afc9f57ac2f081b0/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:13.834630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8be4-39ec-4b47-8666-eb8b6eedb200 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.834983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8be4-39ec-4b47-8666-eb8b6eedb200 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.835324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8be4-39ec-4b47-8666-eb8b6eedb200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.868116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-41ed8be4-39ec-4b47-8666-eb8b6eedb200 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:13.869853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-41ed8be4-39ec-4b47-8666-eb8b6eedb200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:13.886081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 812/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/d5b8923fbdc54938aa80a75bc0d7d6d5/users/0a571e4eeb5446ee9cb606a0c4e83c7d/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:13.891694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.891694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.891694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.911864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:13.913610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:13.940059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 800/1612] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:13.951980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947290-c266-4897-8756-508dacac58e2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:13.952276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947290-c266-4897-8756-508dacac58e2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:13.952559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947290-c266-4897-8756-508dacac58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:13.981918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9b947290-c266-4897-8756-508dacac58e2 None None] MFA Rules not processed for user `0fe4db405646440db99f2186dcd205f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:13.983123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9b947290-c266-4897-8756-508dacac58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:13.987455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 813/1613] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:13.987455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:13.999812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea1ad-85f6-43b0-a873-7fb45f2fea00 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.005509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.006723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.007005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.007277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] PATH_INFO: `/v3/projects/0d81f40b84784ce5bc103294dc08507e/users/fd19d3679a484a47a9413975fb45dece/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.022589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d81f40b84784ce5bc103294dc08507e, user_id=fd19d3679a484a47a9413975fb45dece, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.025400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6e99-6608-4a49-91f5-3b1b4d4c444e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.063573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 801/1614] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:14.063573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.063573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.063573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.090546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] MFA Rules not processed for user `b511a97f2c9e4197afc9f57ac2f081b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:14.091891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:14.116817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 814/1615] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:13 2022] PUT /identity/v3/projects/0d81f40b84784ce5bc103294dc08507e/users/fd19d3679a484a47a9413975fb45dece/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:14.116817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9beeb7-df04-4761-bb78-0e551af283a4 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.116817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9beeb7-df04-4761-bb78-0e551af283a4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.116817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9beeb7-df04-4761-bb78-0e551af283a4 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.117914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 815/1616] 10.222.0.23 () {54 vars in 912 bytes} [Mon Feb 28 13:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:14.119233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.119665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.120095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.138739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:14.140147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:14.167840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 802/1617] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:14.168880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.204305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 816/1618] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:14.205220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.222599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235358-a637-4b76-9a9e-7ca4ed172fdd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.260367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb360-32e7-47d9-bed4-7d3d58ac2c7b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.264168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.264837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.265282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.265610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.270747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.272698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.272698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.272698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.277907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.280460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.282273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.283780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a001120-7caa-4bf3-93d3-80fb0239f890 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.292283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 817/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:14.292845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.294343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 803/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:14.295633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27034-8ceb-46cd-b0d3-17307806ee59 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.295926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27034-8ceb-46cd-b0d3-17307806ee59 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.296208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27034-8ceb-46cd-b0d3-17307806ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.308412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee9b9-5a5d-400e-a6f7-1441d0121614 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.313867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4fc27034-8ceb-46cd-b0d3-17307806ee59 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:14.314891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.315064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4fc27034-8ceb-46cd-b0d3-17307806ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:14.317079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.317712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.318108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.319017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.321659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.323700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 804/1621] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:14.324864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.325157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.325439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.353061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:14.354335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:14.403996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 818/1622] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:14.409452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.443837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 805/1623] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:14.444869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.454994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6070021-74e9-4c24-95cc-5ca6e1d6f22e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.522920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.523732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.524016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.524513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.542864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d0e2-006c-462e-805c-1ba3248a38ab admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.548596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.549255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.549539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.549967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.550656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.552900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.594414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.596008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.608658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 806/1624] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:14.609570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.622110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5cc0c-8436-4eb6-b01d-c9d18f63a78b service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.627408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.628591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.628984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.629425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.644384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 819/1625] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:14.648023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.650423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.654686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.673112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 807/1626] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:14.674181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.733285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd720dd-9d71-4a14-b49c-f5b30ebf8a30 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.737365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c54dc-3951-449f-a6a0-b7e0a90b8004 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.738744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.739633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.741515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.741515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.741515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.743434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.801231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.803787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.804251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.804678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.836211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 820/1627] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:14.836211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.853075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6ef84-1358-4cd7-bf16-c5227007e7fe admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.862167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.863271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.863939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.864654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.866090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.869349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.889256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.892348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.906859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 808/1628] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:14.907661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.926718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a6a4-5878-4f17-b0f0-f91af81b4a69 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.926718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.926718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.926718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.927086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.927086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.927967 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:14.946235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 809/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:14.951275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.956871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 821/1630] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:14 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:14.965073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:14.969780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb5aa-2387-4b41-842d-63b6aa259fe8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.977853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168fdc-7ba1-456b-b2ad-9973d9666a35 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:14.984839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:14.985589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:14.986466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:14.987358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:14.995964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:14.995964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.001311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.002224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.002541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.002841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] PATH_INFO: `/v3/projects/922e1dc910ca4bd5be215926f1584fd3/users/07854253fffc4935b6eeb402a49e4a9c/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.007731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 822/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:15.009344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.025938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37847-4384-4398-90db-9b0a0cdb68a2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.033786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.034903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.039840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.040149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] PATH_INFO: `/v3/projects/11ddd8765a604b20941fb2c485a8cea4/users/97644c871f134cf6bd53b1c49803f810/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.041377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e1dc910ca4bd5be215926f1584fd3, user_id=07854253fffc4935b6eeb402a49e4a9c, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.045189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.063762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ddd8765a604b20941fb2c485a8cea4, user_id=97644c871f134cf6bd53b1c49803f810, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.066402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.141767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 823/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:15 2022] PUT /identity/v3/projects/11ddd8765a604b20941fb2c485a8cea4/users/97644c871f134cf6bd53b1c49803f810/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:15.145844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.154933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 810/1633] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:14 2022] PUT /identity/v3/projects/922e1dc910ca4bd5be215926f1584fd3/users/07854253fffc4935b6eeb402a49e4a9c/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:15.156529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.248311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991e2a-c2f7-4e52-a833-b2ef5e4928aa admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.254717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.256773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.257167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.263623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.263623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.263623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.268730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58254-94a1-4d56-b950-a5155bcd3bea admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.274509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.275433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.275880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.276307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.277164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.278202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 811/1634] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:15.279192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.279745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.291495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdf0e-6811-4312-9488-77fc8fe67ae7 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.295766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 824/1635] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:03:15.297010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.302356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.303938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.304226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.304506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] PATH_INFO: `/v3/projects/922e1dc910ca4bd5be215926f1584fd3/users/07854253fffc4935b6eeb402a49e4a9c/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.306828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922e1dc910ca4bd5be215926f1584fd3, user_id=07854253fffc4935b6eeb402a49e4a9c, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.309471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f48e2-0644-4ae6-8538-2540450d992f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.311652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38b66-730a-43ba-989e-1762fabe17d4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.315305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.316563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.316563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.316820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] PATH_INFO: `/v3/projects/11ddd8765a604b20941fb2c485a8cea4/users/97644c871f134cf6bd53b1c49803f810/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.319732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ddd8765a604b20941fb2c485a8cea4, user_id=97644c871f134cf6bd53b1c49803f810, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.322611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe869b73-e99c-4afa-a4ca-b83e4eee0f37 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.328009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 812/1636] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:15 2022] PUT /identity/v3/projects/922e1dc910ca4bd5be215926f1584fd3/users/07854253fffc4935b6eeb402a49e4a9c/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:15.337548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264e27-68ec-408e-b919-0803925b169b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.338243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264e27-68ec-408e-b919-0803925b169b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.338243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264e27-68ec-408e-b919-0803925b169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.343201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 825/1637] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:15 2022] PUT /identity/v3/projects/11ddd8765a604b20941fb2c485a8cea4/users/97644c871f134cf6bd53b1c49803f810/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:15.365874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.367065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.367065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.404380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] MFA Rules not processed for user `97644c871f134cf6bd53b1c49803f810`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:15.406125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:15.432221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-41264e27-68ec-408e-b919-0803925b169b None None] MFA Rules not processed for user `07854253fffc4935b6eeb402a49e4a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:15.436106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-41264e27-68ec-408e-b919-0803925b169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:15.524561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 826/1638] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:15.531859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.580963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 813/1639] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:15.610911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6cae-a827-4deb-bd57-e13a13f3866f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.622692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.624059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.624442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.624895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.645979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.648903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebe6cb-18a1-4255-a297-f2f1e9b46dde service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.666437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 827/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:03:15.864312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264e27-68ec-408e-b919-0803925b169b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:15.878982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264e27-68ec-408e-b919-0803925b169b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:15.888150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:15.888989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:15.889277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:15.889558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:15.910227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:15.916848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:15.952443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 814/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:16.028918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf90cc-fa4c-4948-9acc-690b528bf29a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.029686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf90cc-fa4c-4948-9acc-690b528bf29a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.030199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf90cc-fa4c-4948-9acc-690b528bf29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.089467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-dacf90cc-fa4c-4948-9acc-690b528bf29a None None] MFA Rules not processed for user `69b4c5f51c5943ef95fd751c67d2e901`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:16.092788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dacf90cc-fa4c-4948-9acc-690b528bf29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:16.241656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:16.248469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 828/1642] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:16.249963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.250257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.250539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.263804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de08-de28-41a5-b071-dd7b55c0f731 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:16.275739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:16.277053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.277461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.277845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.286634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] MFA Rules not processed for user `69b4c5f51c5943ef95fd751c67d2e901`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:16.288236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:16.302623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 829/1643] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:16.308766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:16.319427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa438bb7-ae97-47b0-a50d-75a216a2b15d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:16.323541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:16.324659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.324659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.324884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.387811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:16.389756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:16.393251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:16.395000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76b131-4e82-43be-9a98-9822f6f38e00 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:16.407038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 815/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:16.408140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:16.415569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 830/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:16.524166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447cd0d-20d1-479b-bec4-b0b3cece20ea service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:16.530315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:16.531018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.531309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.531634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.541336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:16.543088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56794b-2e0e-4c3c-9e06-cfbffa471baa service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:16.567809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 816/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:16.664679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6d1d-0628-4279-89dc-7d872562dae0 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.665273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6d1d-0628-4279-89dc-7d872562dae0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.665794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6d1d-0628-4279-89dc-7d872562dae0 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.669700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 831/1647] 10.222.0.23 () {54 vars in 961 bytes} [Mon Feb 28 13:03:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:16.685842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9814fa-dfae-4edc-8e25-2e8ad9f8b706 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.686171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9814fa-dfae-4edc-8e25-2e8ad9f8b706 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.686470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9814fa-dfae-4edc-8e25-2e8ad9f8b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.741096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-df9814fa-dfae-4edc-8e25-2e8ad9f8b706 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:16.742383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-df9814fa-dfae-4edc-8e25-2e8ad9f8b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:16.760681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 817/1648] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Feb 28 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:16.768987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef50e5-66dd-450c-b8b3-2a58aab2fbdc None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.769297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef50e5-66dd-450c-b8b3-2a58aab2fbdc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.769591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef50e5-66dd-450c-b8b3-2a58aab2fbdc None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.771686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 832/1649] 10.222.0.23 () {54 vars in 912 bytes} [Mon Feb 28 13:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:16.777417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.777698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.777982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.802890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:16.804164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:16.822268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 818/1650] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:16.898018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:16.898018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:16.898018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:16.982661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] MFA Rules not processed for user `0a571e4eeb5446ee9cb606a0c4e83c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:16.994398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:17.007700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:17.022846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471dff5-14cb-4fff-8fa5-a005643290b8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:17.035425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:17.039174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.039174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.039174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.060245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:17.062134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c4f-eac1-4a90-bfc6-6b390934e759 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:17.105853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 819/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:03:17.144558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 833/1652] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:17.154460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16a7b-9a02-4ab8-8637-0d71ac8b7ca5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.157333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16a7b-9a02-4ab8-8637-0d71ac8b7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.157333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd16a7b-9a02-4ab8-8637-0d71ac8b7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.186308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bdd16a7b-9a02-4ab8-8637-0d71ac8b7ca5 None None] MFA Rules not processed for user `0a571e4eeb5446ee9cb606a0c4e83c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:17.187700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bdd16a7b-9a02-4ab8-8637-0d71ac8b7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:17.206051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 820/1653] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:17.220387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:17.234623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f401188-9f12-44ea-aab1-6320be11aaf4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:17.242018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:17.242733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.243068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.243347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.255523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:17.257438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e247a4-acae-47db-af8f-7451bf163b18 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:17.270546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 834/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:17.385162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f213-5abd-427a-a708-fd65e17903c3 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.385781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f213-5abd-427a-a708-fd65e17903c3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.385781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f213-5abd-427a-a708-fd65e17903c3 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.388718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 821/1655] 10.222.0.23 () {54 vars in 912 bytes} [Mon Feb 28 13:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:17.395886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50b7f-dcb2-4f2b-9b3f-c2dbbd462511 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.396214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50b7f-dcb2-4f2b-9b3f-c2dbbd462511 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.396789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab50b7f-dcb2-4f2b-9b3f-c2dbbd462511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.461239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5ab50b7f-dcb2-4f2b-9b3f-c2dbbd462511 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:17.462583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5ab50b7f-dcb2-4f2b-9b3f-c2dbbd462511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:17.531961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 835/1656] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:03:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:17.575960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f213-5abd-427a-a708-fd65e17903c3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:17.591646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f213-5abd-427a-a708-fd65e17903c3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:17.595490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:17.596237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.596634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.596994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.605807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:17.607396 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a38c2-ea8c-40f8-a0d1-9cd65273fda1 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:17.625483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 822/1657] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:17.978549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d198a4-51cf-4cf8-b7b5-cec884b0df2e None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.979374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d198a4-51cf-4cf8-b7b5-cec884b0df2e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.979374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d198a4-51cf-4cf8-b7b5-cec884b0df2e None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:17.981767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 836/1658] 10.222.0.23 () {54 vars in 912 bytes} [Mon Feb 28 13:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:17.987088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea129a3-7d8a-4cb9-a64b-e89417731183 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:17.987366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea129a3-7d8a-4cb9-a64b-e89417731183 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:17.988322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea129a3-7d8a-4cb9-a64b-e89417731183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:18.035035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bea129a3-7d8a-4cb9-a64b-e89417731183 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:18.039577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bea129a3-7d8a-4cb9-a64b-e89417731183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:18.057347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 823/1659] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:03:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:18.147267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d198a4-51cf-4cf8-b7b5-cec884b0df2e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:18.164795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d198a4-51cf-4cf8-b7b5-cec884b0df2e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:18.172414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:18.173193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:18.173721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:18.174215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:18.191080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:18.192871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0b9e0-0f5c-4707-acd9-67b5622d496e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:18.217450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 837/1660] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:18.764966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e59a1-5bc8-457d-9d53-69aea89176e9 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:18.764966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e59a1-5bc8-457d-9d53-69aea89176e9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:18.764966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e59a1-5bc8-457d-9d53-69aea89176e9 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:18.764966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 824/1661] 10.222.0.23 () {54 vars in 960 bytes} [Mon Feb 28 13:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:18.774772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab734-022a-4b07-b9b0-c4ded72eb2f8 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:18.774772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab734-022a-4b07-b9b0-c4ded72eb2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:18.774772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab734-022a-4b07-b9b0-c4ded72eb2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:18.774772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-048ab734-022a-4b07-b9b0-c4ded72eb2f8 None None] MFA Rules not processed for user `a0f16bdb11e5491aaadf0946b50a1e30`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:18.780117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-048ab734-022a-4b07-b9b0-c4ded72eb2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:18.939086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 838/1662] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Feb 28 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:18.947009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e59a1-5bc8-457d-9d53-69aea89176e9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:18.964008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e59a1-5bc8-457d-9d53-69aea89176e9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:18.969297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:18.970175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:18.970626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:18.971231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:18.973273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:18.986906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:18.988994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfab77-02c5-4914-8c07-0001c0b176f0 service placement] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:19.011631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 825/1663] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:21.921054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:21.921585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:21.921585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:21.950197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] MFA Rules not processed for user `6324b4a3b7af4af2a1e598f8089853b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:21.951412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:22.019902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 839/1664] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:22.030162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:22.030639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:22.030728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:22.047851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] MFA Rules not processed for user `6324b4a3b7af4af2a1e598f8089853b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:22.049034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:22.056740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 826/1665] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:22.067143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:22.080176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5a57-f793-4814-aef3-6ce89ba643a7 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:22.086103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:22.086247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:22.086532 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:22.086807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:22.094418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:22.096073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807e0c3-463e-4aa4-ae0c-c3dc25396b8a service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:22.104639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 840/1666] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:22.723745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:22.854609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720945df-6365-41fc-bfcb-54a7daffedb4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:22.862654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:22.865175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:22.872213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:22.872213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] PATH_INFO: `/v3/users/aa94fa12c3e84c55a21626c44ad8ba9a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:22.872213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa94fa12c3e84c55a21626c44ad8ba9a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:22.872954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: WARNING py.warnings [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:22.872954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: warnings.warn(msg) Feb 28 13:03:22.872954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: Feb 28 13:03:22.876005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:23.203723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa94fa12c3e84c55a21626c44ad8ba9a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:23.204762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa94fa12c3e84c55a21626c44ad8ba9a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:23.205497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa94fa12c3e84c55a21626c44ad8ba9a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:23.260923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa94fa12c3e84c55a21626c44ad8ba9a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:23.276748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa94fa12c3e84c55a21626c44ad8ba9a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:23.305610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 827/1667] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:22 2022] DELETE /identity/v3/users/aa94fa12c3e84c55a21626c44ad8ba9a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:23.309912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bd7-56fd-403b-89cc-f05a29d8747b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:23.310729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bd7-56fd-403b-89cc-f05a29d8747b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:23.311021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6bd7-56fd-403b-89cc-f05a29d8747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:23.328754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-14cd6bd7-56fd-403b-89cc-f05a29d8747b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:23.329943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-14cd6bd7-56fd-403b-89cc-f05a29d8747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:23.403659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 841/1668] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:23.407267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:23.409323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:23.475203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920877db-e7eb-4775-863b-dffef1d9f8a3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:23.479725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:23.481576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:23.482051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:23.482472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:23.494733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:23.496756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:23.512365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 828/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:23.994235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164403d-66e1-4124-b61f-06708a86113d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:23.994809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164403d-66e1-4124-b61f-06708a86113d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:23.995279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164403d-66e1-4124-b61f-06708a86113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:24.014950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c164403d-66e1-4124-b61f-06708a86113d None None] MFA Rules not processed for user `6324b4a3b7af4af2a1e598f8089853b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:24.016663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c164403d-66e1-4124-b61f-06708a86113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:24.096195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 842/1670] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:24.590555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:24.592551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:24.623894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4708-e09a-436b-ac08-4ec23f9d7a1e service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:24.637494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:24.641271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:24.641271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:24.641271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] PATH_INFO: `/v3/projects/3c22aa8aca9d45969301f160ec25cc4e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:24.641271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c22aa8aca9d45969301f160ec25cc4e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:24.643354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:24.828734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c22aa8aca9d45969301f160ec25cc4e', 'request_id': 'req-9b72ee28-a585-46b0-bd7d-52fb782750c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:24.902145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c22aa8aca9d45969301f160ec25cc4e', 'request_id': 'req-9b72ee28-a585-46b0-bd7d-52fb782750c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:24.910260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c22aa8aca9d45969301f160ec25cc4e', 'request_id': 'req-9b72ee28-a585-46b0-bd7d-52fb782750c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:24.940865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] The token cache is being invalidate because project 3c22aa8aca9d45969301f160ec25cc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:24.940865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:24.944669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9b72ee28-a585-46b0-bd7d-52fb782750c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:24.955575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 829/1671] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:24 2022] DELETE /identity/v3/projects/3c22aa8aca9d45969301f160ec25cc4e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:24.957730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:24.959305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:24.959754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:24.993215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:24.994613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:25.080339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 843/1672] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:25.081521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.081866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.082242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.148690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:25.150302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:25.174589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 830/1673] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:25.179765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.196067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e393ad4-bdab-413b-ab60-24bf84335cb7 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.203179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.204313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.204601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.204931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.206194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:25.206506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.208780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.226162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 844/1674] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:25.230561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.242614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952935b-07ae-44fa-a929-37dc90c98209 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.256954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.257796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.258187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.258573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.259393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.261498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.396723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 831/1675] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:25 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:25.402909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.447034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba29cc-5510-4303-8c14-5fa8abeb874d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.575801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.576749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.577185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.577611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.579323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.581929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.680782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 845/1676] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:25 2022] POST /identity/v3/users => generated 303 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:25.693343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.706667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357d2f-305c-4620-bab5-74474cfe2a99 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.714943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.731567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.732202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.732699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.733691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.742749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.758129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 832/1677] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:25.762341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.784946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d749-f888-4003-98d4-84cb452765ed admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.798049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.798831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.799121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.799574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.800399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.803378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1ed50-63d4-41d4-a660-e8194c00c3f2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.819550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 846/1678] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:25.820841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:25.844170 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25296b58-0f9d-4f31-b0a1-a5c88c6119e1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:25.855308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:25.856491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.857175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.858435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] PATH_INFO: `/v3/projects/3f3a06cc61fc4b2bbea43f29b6350f6e/users/c3af1980c67247d58fd9f1997dc0bca5/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:25.897533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3a06cc61fc4b2bbea43f29b6350f6e, user_id=c3af1980c67247d58fd9f1997dc0bca5, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:25.901910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:25.981436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 833/1679] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:25 2022] PUT /identity/v3/projects/3f3a06cc61fc4b2bbea43f29b6350f6e/users/c3af1980c67247d58fd9f1997dc0bca5/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:25.995785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:25.998950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:25.999387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:26.066589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] MFA Rules not processed for user `c3af1980c67247d58fd9f1997dc0bca5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:26.066589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:26.316199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 847/1680] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:26.319034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:26.496193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d872239-bd09-4254-a0e9-97a1b0ae28c2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:26.503767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:26.506289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:26.506794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:26.507575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:26.508524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:26.512649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:26.661411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 834/1681] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:26 2022] POST /identity/v3/projects => generated 403 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:26.663273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:26.685103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a796ba-f505-45e9-b2cf-5b9db43e4dcb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:26.849688 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:26.850383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:26.850666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:26.850945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:26.851680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:26.853659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:26.953654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 848/1682] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:26 2022] POST /identity/v3/users => generated 308 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:26.957733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:26.984982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d054d-8960-4484-80c8-9ca71dc4f490 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:27.011755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:27.012508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:27.012770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:27.013046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:27.029444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:27.031092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:27.058153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 835/1683] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:27.064422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:27.088868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe63892-fded-4db7-927f-b54ab7c3b424 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:27.094550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:27.095735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:27.096072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:27.096354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] PATH_INFO: `/v3/projects/011b1dc5e838412ea1d8fba41097545b/users/60f70b2a503545c9b7cf5d3efbaeb5e4/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:27.119134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011b1dc5e838412ea1d8fba41097545b, user_id=60f70b2a503545c9b7cf5d3efbaeb5e4, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:27.122542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:27.268592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 849/1684] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:27 2022] PUT /identity/v3/projects/011b1dc5e838412ea1d8fba41097545b/users/60f70b2a503545c9b7cf5d3efbaeb5e4/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:27.272877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:27.288725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0999f2-3523-454d-8071-689bc6a12960 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:27.470651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:27.471334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:27.471821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:27.472254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:27.473139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:27.475814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ad0a-505a-4a7f-aa6a-6748182fdcff admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:27.500774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 836/1685] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:27.504692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:27.530623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f870b-a656-4237-8cae-41966588b910 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:27.551097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:27.556294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:27.557393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:27.560071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] PATH_INFO: `/v3/projects/011b1dc5e838412ea1d8fba41097545b/users/60f70b2a503545c9b7cf5d3efbaeb5e4/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:27.563065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=011b1dc5e838412ea1d8fba41097545b, user_id=60f70b2a503545c9b7cf5d3efbaeb5e4, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:27.568431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:27.599447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 850/1686] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:27 2022] PUT /identity/v3/projects/011b1dc5e838412ea1d8fba41097545b/users/60f70b2a503545c9b7cf5d3efbaeb5e4/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:03:27.609567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f956f-40db-4cc3-99c9-e7fa41f9a628 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:27.610054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f956f-40db-4cc3-99c9-e7fa41f9a628 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:27.610485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f956f-40db-4cc3-99c9-e7fa41f9a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:27.689309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-cb1f956f-40db-4cc3-99c9-e7fa41f9a628 None None] MFA Rules not processed for user `60f70b2a503545c9b7cf5d3efbaeb5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:27.693676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cb1f956f-40db-4cc3-99c9-e7fa41f9a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:27.937810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 837/1687] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:27.957056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:27.959646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:28.104296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105a36e-dab6-40b3-a51b-fecfe582bafd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:28.116535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:28.117650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:28.118132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:28.118603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:28.144326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:28.144326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:28.149741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:28.150725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:28.151219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:28.165558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 851/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:28.203053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] MFA Rules not processed for user `7d58150b0d994ef5b9e2f45af9d79440`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:28.204615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:28.360872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 838/1689] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:28.373296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:28.375097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:28.513666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a86b-b56a-4b16-b19c-a25e1849b353 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:28.530837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:28.531545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:28.531818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:28.532087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:28.549943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:28.552152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e040ac6-ff05-46bd-8b07-d077c00a4e89 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:28.572102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 852/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:28.963758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:29.084930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca0da-3225-4a26-8a01-8cbcce6f66be None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:29.091787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:29.093890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:29.094808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:29.095302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] PATH_INFO: `/v3/users/c3af1980c67247d58fd9f1997dc0bca5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:29.097370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3af1980c67247d58fd9f1997dc0bca5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:29.101089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:29.367269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3af1980c67247d58fd9f1997dc0bca5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:29.370880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3af1980c67247d58fd9f1997dc0bca5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:29.374754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3af1980c67247d58fd9f1997dc0bca5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:29.523556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:29.524418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:29.524887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:29.578123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] MFA Rules not processed for user `fd19d3679a484a47a9413975fb45dece`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:29.579844 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:29.609974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3af1980c67247d58fd9f1997dc0bca5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:29.642283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fe33cbae-6e51-4139-93c7-3b3d58c2d923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3af1980c67247d58fd9f1997dc0bca5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:29.690587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 853/1691] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:29.708013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 839/1692] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:28 2022] DELETE /identity/v3/users/c3af1980c67247d58fd9f1997dc0bca5 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:29.711218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:29.713041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:29.718633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647975-676d-4998-b2a7-7462e935ff4c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:29.719078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647975-676d-4998-b2a7-7462e935ff4c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:29.719379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647975-676d-4998-b2a7-7462e935ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:29.795400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3c647975-676d-4998-b2a7-7462e935ff4c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:29.801512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da57625-1797-4540-80f7-4c7c983b8523 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:29.809507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3c647975-676d-4998-b2a7-7462e935ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:29.938304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:29.939321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:29.939855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:29.956072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:29.986422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 840/1693] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:29.990033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d75198-060c-473e-8e50-9b128468c95e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:29.990988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d75198-060c-473e-8e50-9b128468c95e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:29.993618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d75198-060c-473e-8e50-9b128468c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:30.049487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-17d75198-060c-473e-8e50-9b128468c95e None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:30.051638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-17d75198-060c-473e-8e50-9b128468c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:30.077021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:30.078871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:30.096679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 854/1694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:30.097703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:30.099444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:30.195834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25387d2-5462-474b-ba14-aecf38654944 service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:30.201470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:30.202477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:30.202896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:30.203183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:30.216695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:30.218540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:30.230140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 841/1695] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:30.245721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 855/1696] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:30.814972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d75198-060c-473e-8e50-9b128468c95e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:30.816583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-17d75198-060c-473e-8e50-9b128468c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:31.051723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d75198-060c-473e-8e50-9b128468c95e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:31.079570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76df716-5add-4986-afd0-96089c424172 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:31.080246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df716-5add-4986-afd0-96089c424172 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:31.080537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df716-5add-4986-afd0-96089c424172 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:31.080820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76df716-5add-4986-afd0-96089c424172 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:31.116002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76df716-5add-4986-afd0-96089c424172 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:31.117850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76df716-5add-4986-afd0-96089c424172 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:31.142503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 842/1697] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:03:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:03:33.812698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:33.812698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:33.823918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c85d2-afc5-4d51-ac60-73fe5e59b834 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:33.840469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:33.841664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:33.842101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:33.842527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] PATH_INFO: `/v3/projects/3f3a06cc61fc4b2bbea43f29b6350f6e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:33.843964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3a06cc61fc4b2bbea43f29b6350f6e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:33.845155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: WARNING py.warnings [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 13:03:33.845155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: warnings.warn(msg) Feb 28 13:03:33.845155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: Feb 28 13:03:33.846614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:33.969121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:33.971867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:33.971867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:34.046276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:34.055428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:34.093126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3a06cc61fc4b2bbea43f29b6350f6e', 'request_id': 'req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:34.194929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 843/1698] 10.222.0.35 () {58 vars in 1015 bytes} [Mon Feb 28 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:34.297752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:34.311394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a54e28-fa6c-49d0-b9ea-1debfe8d4657 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:34.325298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:34.326342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:34.326852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:34.329353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3a06cc61fc4b2bbea43f29b6350f6e', 'request_id': 'req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:34.339876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:34.372237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:34.378420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:34.379343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3a06cc61fc4b2bbea43f29b6350f6e', 'request_id': 'req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:34.430855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 844/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:34.432676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:34.436186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:34.439589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] The token cache is being invalidate because project 3f3a06cc61fc4b2bbea43f29b6350f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:34.440616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:34.443800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:34.451621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 856/1700] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:33 2022] DELETE /identity/v3/projects/3f3a06cc61fc4b2bbea43f29b6350f6e => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:34.454537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:34.456312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:34.724634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eb769-bc18-4254-b1fd-0bbab7e60acf admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:34.725078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8e5ac-cdac-459b-b91d-0fb878d11a96 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:34.725521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:34.725521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:34.725521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:34.725521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] PATH_INFO: `/v3/users/60f70b2a503545c9b7cf5d3efbaeb5e4` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:34.726032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:34.726032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:34.726032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:34.726347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f70b2a503545c9b7cf5d3efbaeb5e4)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:34.726347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:34.726501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] PATH_INFO: `/v3/users/b511a97f2c9e4197afc9f57ac2f081b0` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:34.726501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b511a97f2c9e4197afc9f57ac2f081b0)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:34.726501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:35.137822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b511a97f2c9e4197afc9f57ac2f081b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.138531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b511a97f2c9e4197afc9f57ac2f081b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.139158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b511a97f2c9e4197afc9f57ac2f081b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.143448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f70b2a503545c9b7cf5d3efbaeb5e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.147944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f70b2a503545c9b7cf5d3efbaeb5e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.149502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f70b2a503545c9b7cf5d3efbaeb5e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.243605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b511a97f2c9e4197afc9f57ac2f081b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.256506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fdcbbfaa-9fac-41be-8273-90fd2f06f911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b511a97f2c9e4197afc9f57ac2f081b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.325710 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f70b2a503545c9b7cf5d3efbaeb5e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.326144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 845/1701] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:34 2022] DELETE /identity/v3/users/b511a97f2c9e4197afc9f57ac2f081b0 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:35.332288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0510-1011-47f0-9a2d-a646e38a749d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:35.335179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0510-1011-47f0-9a2d-a646e38a749d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:35.335665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0510-1011-47f0-9a2d-a646e38a749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:35.368021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f70b2a503545c9b7cf5d3efbaeb5e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:35.419304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-20fe0510-1011-47f0-9a2d-a646e38a749d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:35.425177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 857/1702] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:34 2022] DELETE /identity/v3/users/60f70b2a503545c9b7cf5d3efbaeb5e4 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:35.532540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-20fe0510-1011-47f0-9a2d-a646e38a749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:35.546167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 846/1703] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:35.923807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:35.925257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:36.107242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746bf26-31a6-4f22-9579-4253c95adac4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:36.138172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:36.139078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:36.139551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:36.139983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:36.166496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:36.169330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bec72-85e3-4b61-911c-2dd5ea710d37 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:36.204147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 858/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:39.096600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b900e9-3ab8-4ad6-8305-c33c63b60e6c None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:39.098314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b900e9-3ab8-4ad6-8305-c33c63b60e6c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:39.098314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b900e9-3ab8-4ad6-8305-c33c63b60e6c None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:39.102457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 847/1705] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:39.172050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:39.172702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:39.172702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:39.318942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:39.318942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:39.357706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393423d-9d3e-48be-b04c-5360a30721be None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:39.358180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393423d-9d3e-48be-b04c-5360a30721be None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:39.358600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393423d-9d3e-48be-b04c-5360a30721be None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:39.363071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 848/1706] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:03:39.455196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:39.456100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:39.456700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:39.503491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 859/1707] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:39.523075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:39.526259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:39.541649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 849/1708] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:40.001489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:40.002952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:40.054576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d9a1c-6aaa-49fa-a442-7d451655921f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:40.068205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:40.072962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:40.073379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:40.073837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:40.099420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:40.102594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:40.123797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:40.130553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:40.147982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa5ede-0e8f-4591-ad79-69e254765907 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:40.170637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:40.170637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:40.170637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:40.170637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] PATH_INFO: `/v3/projects/011b1dc5e838412ea1d8fba41097545b` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:40.178066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 860/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:40.178768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011b1dc5e838412ea1d8fba41097545b)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:40.181409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:40.321384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:40.323317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:40.372852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d664bed-3a64-403b-b334-145d83ae28df service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:40.385518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011b1dc5e838412ea1d8fba41097545b', 'request_id': 'req-9165676f-7f08-487e-8e18-a62648f2f449'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:40.624090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:40.624090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:40.624090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:40.624090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] PATH_INFO: `/v3/projects/1115acdea29c4ee7b98f638847770918` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:40.626034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1115acdea29c4ee7b98f638847770918)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:40.626034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:40.791754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011b1dc5e838412ea1d8fba41097545b', 'request_id': 'req-9165676f-7f08-487e-8e18-a62648f2f449'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:40.803264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011b1dc5e838412ea1d8fba41097545b', 'request_id': 'req-9165676f-7f08-487e-8e18-a62648f2f449'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:40.827069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] The token cache is being invalidate because project 011b1dc5e838412ea1d8fba41097545b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:40.827364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:40.828187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:40.830260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 850/1710] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:40 2022] DELETE /identity/v3/projects/011b1dc5e838412ea1d8fba41097545b => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:40.831371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:40.833111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:40.882945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1115acdea29c4ee7b98f638847770918', 'request_id': 'req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.020611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165676f-7f08-487e-8e18-a62648f2f449 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:41.025925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1115acdea29c4ee7b98f638847770918', 'request_id': 'req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.037600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1115acdea29c4ee7b98f638847770918', 'request_id': 'req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.072274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] The token cache is being invalidate because project 1115acdea29c4ee7b98f638847770918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:41.072914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.074403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e7c3c0e-b7c6-4c90-a362-54cd077207ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.081250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 861/1711] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:40 2022] DELETE /identity/v3/projects/1115acdea29c4ee7b98f638847770918 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:03:41.083428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2744c1-cd4c-4be2-9b88-9d603ddf2911 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.083904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2744c1-cd4c-4be2-9b88-9d603ddf2911 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.084596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2744c1-cd4c-4be2-9b88-9d603ddf2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.124595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0e2744c1-cd4c-4be2-9b88-9d603ddf2911 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:41.127160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0e2744c1-cd4c-4be2-9b88-9d603ddf2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:41.229888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:41.232228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.233690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.234204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.241048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:41.263783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:41.265724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:41.285382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 851/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:41.287835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:41.289824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:41.319073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 862/1713] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:41.320893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b916e0d-cfc9-4c7c-ad4b-67b6a6b84212 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.321190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b916e0d-cfc9-4c7c-ad4b-67b6a6b84212 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.321474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b916e0d-cfc9-4c7c-ad4b-67b6a6b84212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.347393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4b916e0d-cfc9-4c7c-ad4b-67b6a6b84212 None None] MFA Rules not processed for user `7d58150b0d994ef5b9e2f45af9d79440`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:41.351213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4b916e0d-cfc9-4c7c-ad4b-67b6a6b84212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:41.393355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce26-522b-475d-9c42-45413ea1ae93 service nova] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:41.399089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:41.400379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.400783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.401173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] PATH_INFO: `/v3/users/97644c871f134cf6bd53b1c49803f810` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.402812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97644c871f134cf6bd53b1c49803f810)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:41.404909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:41.460796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 863/1714] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:41.462843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.463415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.463941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.502136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:41.503348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:41.534033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 864/1715] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:41.539235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:41.558172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54032cc-bd58-4357-958d-0d3bfd75b56c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:41.585636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:41.587719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.588094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.588487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.590836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:41.591345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:41.593875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:41.631125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 865/1716] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:41.632941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:41.656250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983adbef-977b-43e3-acf7-e892e43533b7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:41.737770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:41.737770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:41.737770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:41.737770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:41.738818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:41.738818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:41.932914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 866/1717] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:41 2022] POST /identity/v3/projects => generated 355 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:41.937349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:41.953723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97644c871f134cf6bd53b1c49803f810'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.954778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97644c871f134cf6bd53b1c49803f810'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:41.956224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97644c871f134cf6bd53b1c49803f810'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:42.158705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8617b2e-7212-48bd-8110-c27715089e9c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:42.165712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:42.166976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.166976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.167714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.168889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:42.178670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:42.185755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97644c871f134cf6bd53b1c49803f810'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:42.196568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8bd85c7d-93cd-48ee-9c77-e59017667a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97644c871f134cf6bd53b1c49803f810'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:42.225766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 852/1718] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:41 2022] DELETE /identity/v3/users/97644c871f134cf6bd53b1c49803f810 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:42.228465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.229175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.229683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.252303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] MFA Rules not processed for user `fd19d3679a484a47a9413975fb45dece`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:42.253629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:42.289036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 867/1719] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:41 2022] POST /identity/v3/users => generated 278 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:42.300046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:42.308947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:42.358364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81c80-8d0e-4585-8b41-74381fe3768b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:42.422414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 853/1720] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:42.450438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:42.451461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.452014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.452462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.453384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:42.455282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:42.466626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 868/1721] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:03:42.470737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:42.484433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25b10-69c1-459a-b5ab-f3d663097769 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:42.491893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:42.492814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.493206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.493548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.494400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:42.496167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e329a63-4e51-4658-ad44-8e4921d9c16d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:42.513136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 854/1722] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:03:42.514381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:42.541331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4553f9-d569-4b3c-a5eb-9b5ff5452556 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:42.556190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:42.562075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.562075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.562075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] PATH_INFO: `/v3/projects/2fdcfdbfa2a84aea8c6bf5a7e0bafaec/users/9e0ac795723a4e94bf95fa9568eebaf9/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.616781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdcfdbfa2a84aea8c6bf5a7e0bafaec, user_id=9e0ac795723a4e94bf95fa9568eebaf9, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:42.625078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:42.768950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 869/1723] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:42 2022] PUT /identity/v3/projects/2fdcfdbfa2a84aea8c6bf5a7e0bafaec/users/9e0ac795723a4e94bf95fa9568eebaf9/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:42.779083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:42.779725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:42.780309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:42.846139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] MFA Rules not processed for user `9e0ac795723a4e94bf95fa9568eebaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:42.850168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:43.003805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 855/1724] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:43.008236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.130585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124241ac-7ae3-49d4-862e-143cf4893606 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.139674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.140403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.140659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.140930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.141834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.144159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.262279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.263757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:43.272454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 870/1725] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:43 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:43.273428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.307851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b094b54-0b16-4e7c-935a-62f83364c8c7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.426414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e935d-8f92-48fb-97fa-d5d8d5960ab5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.426414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.426414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.426414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.427535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.427535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.427535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.477764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.479513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.479873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.480093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] PATH_INFO: `/v3/projects/11ddd8765a604b20941fb2c485a8cea4` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.482079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ddd8765a604b20941fb2c485a8cea4)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.484440 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.655253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 871/1726] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:43 2022] POST /identity/v3/users => generated 284 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:43.658595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.681739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17fd3-d3d7-474f-a213-53c08fbd7856 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.684319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ddd8765a604b20941fb2c485a8cea4', 'request_id': 'req-184d5719-15c2-4dee-b4c5-4d61fe5236a5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:43.752216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ddd8765a604b20941fb2c485a8cea4', 'request_id': 'req-184d5719-15c2-4dee-b4c5-4d61fe5236a5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:43.759352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ddd8765a604b20941fb2c485a8cea4', 'request_id': 'req-184d5719-15c2-4dee-b4c5-4d61fe5236a5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:43.794261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] The token cache is being invalidate because project 11ddd8765a604b20941fb2c485a8cea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:43.794567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:43.795451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-184d5719-15c2-4dee-b4c5-4d61fe5236a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:43.799511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 856/1727] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:43 2022] DELETE /identity/v3/projects/11ddd8765a604b20941fb2c485a8cea4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:43.805701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff51c-44f9-477e-90c6-dfa44df9d5c5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.806575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff51c-44f9-477e-90c6-dfa44df9d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.807437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff51c-44f9-477e-90c6-dfa44df9d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.811515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.812466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.813298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.813298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.813983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.815751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.843635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-00aff51c-44f9-477e-90c6-dfa44df9d5c5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:43.848082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-00aff51c-44f9-477e-90c6-dfa44df9d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:43.859905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 872/1728] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:43.861051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.867517 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:43.868648 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 857/1729] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:43.872120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.875014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.875014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.886940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590859d-e6fe-4d5e-8c09-9a47f734de28 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.891848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.892896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.893311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.893678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] PATH_INFO: `/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e/users/dbf7ee183a0b41fe89b582453ad004b0/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.897938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:43.903589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:43.909463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 858/1730] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:43.914519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:43.923705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbf2a2e4a4a4ee0b44b082aae9d1b4e, user_id=dbf7ee183a0b41fe89b582453ad004b0, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.927704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.932285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c86e-7231-4807-a0e0-bcd665b9b96b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:43.948916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:43.950146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:43.950834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:43.951220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:43.952612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:43.952612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:43.954658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:43.991565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 859/1731] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:03:43.991565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.001889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2d624-1583-4ee3-adce-61592096f639 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.008331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.009094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.009388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.009714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.010433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.012559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.041629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 873/1732] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:43 2022] PUT /identity/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e/users/dbf7ee183a0b41fe89b582453ad004b0/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:44.042763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.121296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 860/1733] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:43 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:44.125116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.132997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63fb9-82d0-4f34-a3b7-981b147ea962 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.230422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb43de-aa34-4a33-afe4-549d67eff8ab admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.238217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.238217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.238217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.238552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.239349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.242124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.256815 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.257867 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.258414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.258952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.259808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.261729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.273281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 874/1734] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:44.278060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.288327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64827db-df7d-41f2-824b-8f0701d0b74c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.293060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.293950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.294234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.294675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] PATH_INFO: `/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e/users/dbf7ee183a0b41fe89b582453ad004b0/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.296931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbf2a2e4a4a4ee0b44b082aae9d1b4e, user_id=dbf7ee183a0b41fe89b582453ad004b0, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.299687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba923f3-33cb-4f99-85e8-63e358863133 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.312117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 875/1735] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:44 2022] PUT /identity/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e/users/dbf7ee183a0b41fe89b582453ad004b0/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:03:44.322687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.323195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.323715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.336685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 861/1736] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:44 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:44.341018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.357874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a5c5e-eedd-4171-bb57-abf275c8fd46 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.364361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] MFA Rules not processed for user `dbf7ee183a0b41fe89b582453ad004b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:44.366042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:44.419770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.421204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.421675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.422364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.423731 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.427077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.465778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 862/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:03:44.466770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.468764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 876/1738] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:44.469754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.471219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:44.478154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bce35e-e260-4d67-9f18-e08c5ffea772 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.489743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.489743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.489743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.489743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.490134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.490134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.499627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 863/1739] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:44.503805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.521227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c42e-4683-49eb-bf82-ce23c3daaeb6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.530448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.531435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.531843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.532243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] PATH_INFO: `/v3/projects/0977185ace2d42c98d33c95da6274e58/users/2396afbca26d4456b6062f14ed4a7a70/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.548272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e71357-28d5-4106-b1c3-20a146f3942a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.558919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.559716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.560119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.560461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.580579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.580579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092091d4-5d0b-4d20-a9fa-49599e89245b service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.582553 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0977185ace2d42c98d33c95da6274e58, user_id=2396afbca26d4456b6062f14ed4a7a70, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.585882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.600043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 877/1740] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:44.645334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 864/1741] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:44 2022] PUT /identity/v3/projects/0977185ace2d42c98d33c95da6274e58/users/2396afbca26d4456b6062f14ed4a7a70/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:44.655708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.656002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.656295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.739864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] MFA Rules not processed for user `2396afbca26d4456b6062f14ed4a7a70`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:44.743401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:44.873095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.882733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 878/1742] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:44.883696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:44.977719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17382bb-11f1-4167-b577-e71167ebfed6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.983551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:44.984154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:44.984915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:44.985283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:44.986142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:44.988294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:44.992903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fac4-0a7b-465b-83ce-705348c06b3a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:44.999509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.000397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.001214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.001214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.003639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:45.089362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.091987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.111296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 865/1743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:03:45.116903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 879/1744] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:44 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:45.120988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.153033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc2b7-787a-4b53-9e49-a8cc37431e6b service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.230404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.231090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.231380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.231755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.232510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.234735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.324157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 866/1745] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:45 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:45.328510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.341304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c29a8-cb3d-4a43-8442-1aad173aec38 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.351916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.352618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.352917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.353259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.354021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.360020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.385948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 880/1746] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:45.394358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.406331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7803d8-02c7-4d1b-be58-ef6e6ffe6e14 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.413263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.414348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.414782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.415206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] PATH_INFO: `/v3/projects/d7ea11991d984cc3b64288f094ae87a9/users/685c7faf8cde47579a4679df1cb4a2de/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.504303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ea11991d984cc3b64288f094ae87a9, user_id=685c7faf8cde47579a4679df1cb4a2de, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.507110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.628642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 867/1747] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:45 2022] PUT /identity/v3/projects/d7ea11991d984cc3b64288f094ae87a9/users/685c7faf8cde47579a4679df1cb4a2de/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:45.633078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.649623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592c48-b743-40d5-98b4-b3bca0385acc admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.724106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.724775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.725058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.725336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.726089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.727737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996b356-920f-4183-a63b-681f52fd33b5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.740727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 881/1748] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:45.741876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.752000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ddfdf-1026-4fb5-b240-3ad0f902a3e5 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.760523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.767349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.767349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.767349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] PATH_INFO: `/v3/projects/d7ea11991d984cc3b64288f094ae87a9/users/685c7faf8cde47579a4679df1cb4a2de/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.767349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ea11991d984cc3b64288f094ae87a9, user_id=685c7faf8cde47579a4679df1cb4a2de, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.767349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.780656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 868/1749] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:45 2022] PUT /identity/v3/projects/d7ea11991d984cc3b64288f094ae87a9/users/685c7faf8cde47579a4679df1cb4a2de/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:45.794379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.794782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.795069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.822599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] MFA Rules not processed for user `685c7faf8cde47579a4679df1cb4a2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:45.824056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:45.901176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 882/1750] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:45.911908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:45.968738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db5411-f431-4066-b8b6-89d42051e7d0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:45.972577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:45.977481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:45.977481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:45.977481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:45.982824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:45.984353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2da1-0ce5-4805-8030-4ce6d7e2990b service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:45.994248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 869/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:49.382390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:49.465636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556b1b5-42af-4367-9848-ae7025410993 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:49.477027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:49.477027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:49.477027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:49.477027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] PATH_INFO: `/v3/users/2396afbca26d4456b6062f14ed4a7a70` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:49.477413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2396afbca26d4456b6062f14ed4a7a70)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:49.477413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:49.646618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2396afbca26d4456b6062f14ed4a7a70'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:49.647281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2396afbca26d4456b6062f14ed4a7a70'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:49.647924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2396afbca26d4456b6062f14ed4a7a70'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:49.722774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2396afbca26d4456b6062f14ed4a7a70'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:49.735845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2396afbca26d4456b6062f14ed4a7a70'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:49.748253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 883/1752] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:49 2022] DELETE /identity/v3/users/2396afbca26d4456b6062f14ed4a7a70 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:49.752716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:49.754019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:49.754019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:49.771187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:49.772466 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:49.836880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 870/1753] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:49.846370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:49.847835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:49.916561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1cb1-e842-4d17-97a3-7921349bfc87 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:49.921174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:49.921822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:49.922105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:49.922386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:49.935294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:49.936948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:49.947616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 884/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:51.189305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:51.190705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:51.202965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d680e-7419-43bd-bda1-fae2307177cb None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:51.207582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:51.208946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:51.209230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:51.209504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] PATH_INFO: `/v3/projects/0977185ace2d42c98d33c95da6274e58` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:51.210677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0977185ace2d42c98d33c95da6274e58)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:51.212727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:51.329256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0977185ace2d42c98d33c95da6274e58', 'request_id': 'req-d7fb82fa-928b-4d0d-a495-0a4405be5584'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.414345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0977185ace2d42c98d33c95da6274e58', 'request_id': 'req-d7fb82fa-928b-4d0d-a495-0a4405be5584'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.420572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0977185ace2d42c98d33c95da6274e58', 'request_id': 'req-d7fb82fa-928b-4d0d-a495-0a4405be5584'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.432720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] The token cache is being invalidate because project 0977185ace2d42c98d33c95da6274e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:51.432720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.433321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.434954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 871/1755] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:51 2022] DELETE /identity/v3/projects/0977185ace2d42c98d33c95da6274e58 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:51.439299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:51.449950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbd964-ea5b-4b88-b861-0179f48aa11e service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:51.510544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:51.511576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:51.511880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:51.512297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] PATH_INFO: `/v3/users/685c7faf8cde47579a4679df1cb4a2de` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:51.513695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=685c7faf8cde47579a4679df1cb4a2de)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:51.515661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:51.703796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685c7faf8cde47579a4679df1cb4a2de'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.704742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685c7faf8cde47579a4679df1cb4a2de'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.705711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685c7faf8cde47579a4679df1cb4a2de'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.774290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685c7faf8cde47579a4679df1cb4a2de'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.791595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-95903b7e-79e3-413c-ba0b-7188cc8c326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685c7faf8cde47579a4679df1cb4a2de'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:51.803188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 885/1756] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:03:51 2022] DELETE /identity/v3/users/685c7faf8cde47579a4679df1cb4a2de => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:52.576558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:52.579352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:52.605470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb82fa-928b-4d0d-a495-0a4405be5584 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:52.673546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:52.674429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:52.674708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:52.674986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] PATH_INFO: `/v3/projects/d7ea11991d984cc3b64288f094ae87a9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:52.677328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ea11991d984cc3b64288f094ae87a9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:52.679379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:52.794301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ea11991d984cc3b64288f094ae87a9', 'request_id': 'req-3b554fe1-6355-428e-8030-0788ca9c982c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:52.802052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36060-75b0-4ce4-9e95-726e6e69758f None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:52.802624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36060-75b0-4ce4-9e95-726e6e69758f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:52.802862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d36060-75b0-4ce4-9e95-726e6e69758f None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:52.805305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 886/1757] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 13:03:52.827696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:52.828144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:52.828582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:52.849141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:52.850432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:52.884728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ea11991d984cc3b64288f094ae87a9', 'request_id': 'req-3b554fe1-6355-428e-8030-0788ca9c982c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:52.891724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ea11991d984cc3b64288f094ae87a9', 'request_id': 'req-3b554fe1-6355-428e-8030-0788ca9c982c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:52.904006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] The token cache is being invalidate because project d7ea11991d984cc3b64288f094ae87a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:03:52.904431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:52.905258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b554fe1-6355-428e-8030-0788ca9c982c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:03:52.907241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 872/1758] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:03:52 2022] DELETE /identity/v3/projects/d7ea11991d984cc3b64288f094ae87a9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:52.913424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:52.913717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:52.914001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:52.941877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 887/1759] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:03:52.943449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:52.945701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:52.962834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:52.964371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:52.979590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf234-1351-4a2a-9cdd-ffacdd01c443 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:52.986092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:52.986812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:52.987166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:52.987542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.006544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.009104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f8318-992c-406a-8cdf-b0939ca9e660 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.022525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 888/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:03:53.031167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 873/1761] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:53.040431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.040693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.040974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.064159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:53.065987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:53.074293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 889/1762] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:53.078551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.089231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee37a6-f57b-4c9d-be4f-8cb2d81d3b84 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.093850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.094504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.094789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.095250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.095882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:03:53.096192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.097788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.113047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 874/1763] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:03:53.114233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.123436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66df3e-6487-46b8-890e-2a8c36c41afa None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.128422 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.129077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.129363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.130233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.130927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.132931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.214667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 890/1764] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:53 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:53.219280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.227373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe22-84f6-46e7-91f4-526654377922 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.304717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.305573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.306480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.307647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.308543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.310831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.429229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 875/1765] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:53 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:03:53.430605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.441182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5c175-82ee-456d-9c08-5b039a88b2f9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.446361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.447194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.447320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.447622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.448352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.449962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.461577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 891/1766] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:53.465869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.475889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955700e7-9e69-46af-a6b3-89b479cc81d3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.480863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.486375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.486375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.486375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.486375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.486375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2982c2-8435-47ec-a861-3013ac2c89f0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.495990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 876/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:03:53.499973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.521615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b64c5-8016-4b49-bec4-60380c53db4c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.530707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.531650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.531972 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.532220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] PATH_INFO: `/v3/projects/ac0acb2cd8984a35bf294aa2fdc31a94/users/073e5f840eeb4318bf42c85a260ade73/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.547131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0acb2cd8984a35bf294aa2fdc31a94, user_id=073e5f840eeb4318bf42c85a260ade73, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.549819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.643793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 892/1768] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:53 2022] PUT /identity/v3/projects/ac0acb2cd8984a35bf294aa2fdc31a94/users/073e5f840eeb4318bf42c85a260ade73/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:53.648995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5bce5-f596-45ea-90d1-450b8e74cbdb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.649471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5bce5-f596-45ea-90d1-450b8e74cbdb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.649788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5bce5-f596-45ea-90d1-450b8e74cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.667816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-47f5bce5-f596-45ea-90d1-450b8e74cbdb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:53.669098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-47f5bce5-f596-45ea-90d1-450b8e74cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:53.731102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 877/1769] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:53.741123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:53.742810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:53.799697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2dbc2-fca2-4058-9cb7-c79a68200fac admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:53.804100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:53.804939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:53.805069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:53.805373 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:53.814401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:53.815859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:53.825111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 893/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:03:55.071164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.071647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.071840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.112020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] MFA Rules not processed for user `073e5f840eeb4318bf42c85a260ade73`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:55.113696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:55.217205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.224169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 878/1771] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:55.233292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23252b-ca2c-425d-b67e-fc793108c3a7 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.237937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.238623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.239064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.239493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.240240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.242238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.371903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 894/1772] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:03:55 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:55.375862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.387430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860450cf-73c8-4b6c-8b23-94829c4f50ea None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.457159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.458588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.458875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.459155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.459918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.461848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.596624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 879/1773] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:03:55 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:03:55.603631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.615676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5874bf-1794-4612-8bad-24481085d172 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.622180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.623024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.623398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.623764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.624553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.626217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.637960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 895/1774] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:55.642119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.653276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2d0e-f9ef-4e96-b056-13d3f9e3a2eb admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.658281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.659190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.659683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.659964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] PATH_INFO: `/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b/users/5378850191f84732ad86360ef2d9b1f8/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.675978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59e64bb1cd04b5eb3392f6261909a9b, user_id=5378850191f84732ad86360ef2d9b1f8, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.679318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.783442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 880/1775] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:55 2022] PUT /identity/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b/users/5378850191f84732ad86360ef2d9b1f8/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:55.787673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.804603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d027b35-451c-480d-926f-1ac9a2bc8172 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.895879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.903892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.904405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.905960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.905960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.908488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a526-18e6-480a-b607-0c84dbbe2edd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.921034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 896/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:03:55.925067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:55.938199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ad9e-385b-4f7a-b049-4410bed0a921 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:55.945507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:55.949388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:55.949388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:55.949388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] PATH_INFO: `/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b/users/5378850191f84732ad86360ef2d9b1f8/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:55.949388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59e64bb1cd04b5eb3392f6261909a9b, user_id=5378850191f84732ad86360ef2d9b1f8, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:55.952136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:55.964482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 881/1777] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:03:55 2022] PUT /identity/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b/users/5378850191f84732ad86360ef2d9b1f8/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:03:57.304508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:57.307965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:57.307965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:57.337624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] MFA Rules not processed for user `5378850191f84732ad86360ef2d9b1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:03:57.337624 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:57.414430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 897/1778] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:03:57.425502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:57.427982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:57.482535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4c06-01e8-4c41-9bc7-02eebbd4a14b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:57.486166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:57.486917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:57.487207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:57.487512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:57.541413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:57.542850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:57.552383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 882/1779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:03:59.235665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:03:59.237036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:03:59.249604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab67c0-9c71-4c48-8955-ec9d5586ccfc None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:03:59.255501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:03:59.256295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:03:59.256999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:03:59.257451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:03:59.278408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:03:59.280930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd007-5fd1-41c5-ae29-0cafbdde8139 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:03:59.305465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 898/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:08.149388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:08.151828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:08.242139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e958a5-7c01-4b41-a61a-2909ba239944 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:08.247831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:08.248795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:08.252647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:08.252647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] PATH_INFO: `/v3/users/9e0ac795723a4e94bf95fa9568eebaf9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:08.252647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0ac795723a4e94bf95fa9568eebaf9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:08.253174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:08.571943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0ac795723a4e94bf95fa9568eebaf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:08.572610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0ac795723a4e94bf95fa9568eebaf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:08.573330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0ac795723a4e94bf95fa9568eebaf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:08.636603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0ac795723a4e94bf95fa9568eebaf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:08.643853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0ac795723a4e94bf95fa9568eebaf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:08.662117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 883/1781] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:08 2022] DELETE /identity/v3/users/9e0ac795723a4e94bf95fa9568eebaf9 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:08.666720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:08.667213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:08.667291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:08.684658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:08.685923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:08.749329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 899/1782] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:08.756886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:08.764947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:08.828120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a983aa-e4ad-4081-8f54-7dc75d949f88 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:08.831715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:08.832907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:08.833195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:08.833470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:08.843660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:08.843973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:08.853472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 884/1783] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:09.301768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:09.303273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:09.325255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaca3b-3501-4ccb-9a6f-ae7769900e4b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:09.330968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:09.334179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:09.334179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:09.334179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] PATH_INFO: `/v3/projects/2fdcfdbfa2a84aea8c6bf5a7e0bafaec` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:09.334179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdcfdbfa2a84aea8c6bf5a7e0bafaec)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:09.336077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:09.470392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdcfdbfa2a84aea8c6bf5a7e0bafaec', 'request_id': 'req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.550807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdcfdbfa2a84aea8c6bf5a7e0bafaec', 'request_id': 'req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.558968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdcfdbfa2a84aea8c6bf5a7e0bafaec', 'request_id': 'req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.574360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] The token cache is being invalidate because project 2fdcfdbfa2a84aea8c6bf5a7e0bafaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:09.574659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.575323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.577566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 900/1784] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:09 2022] DELETE /identity/v3/projects/2fdcfdbfa2a84aea8c6bf5a7e0bafaec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:09.581486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:09.592382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0a09-3ce6-4f91-8b48-ab1bd25d4bc5 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:09.651810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:09.652689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:09.652975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:09.653249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] PATH_INFO: `/v3/users/dbf7ee183a0b41fe89b582453ad004b0` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:09.654443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf7ee183a0b41fe89b582453ad004b0)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:09.656463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:09.848647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf7ee183a0b41fe89b582453ad004b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.849685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf7ee183a0b41fe89b582453ad004b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.851183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf7ee183a0b41fe89b582453ad004b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.933330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf7ee183a0b41fe89b582453ad004b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.940655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-071f7bd2-c975-424d-a285-91a4b48f3549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf7ee183a0b41fe89b582453ad004b0'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:09.959728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 885/1785] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:09 2022] DELETE /identity/v3/users/dbf7ee183a0b41fe89b582453ad004b0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:10.375625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:10.377158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:10.391662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7c46-c882-49dd-8a88-0f3bf9e43e1c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:10.455845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:10.458714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:10.458714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:10.458714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] PATH_INFO: `/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:10.459237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbf2a2e4a4a4ee0b44b082aae9d1b4e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:10.461226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:10.562251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbf2a2e4a4a4ee0b44b082aae9d1b4e', 'request_id': 'req-d90b9893-c282-4ff2-8a67-a19ac994de57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:10.630942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbf2a2e4a4a4ee0b44b082aae9d1b4e', 'request_id': 'req-d90b9893-c282-4ff2-8a67-a19ac994de57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:10.637426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbf2a2e4a4a4ee0b44b082aae9d1b4e', 'request_id': 'req-d90b9893-c282-4ff2-8a67-a19ac994de57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:10.648205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] The token cache is being invalidate because project fcbf2a2e4a4a4ee0b44b082aae9d1b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:10.648495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:10.649192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d90b9893-c282-4ff2-8a67-a19ac994de57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:10.650761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 901/1786] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:10 2022] DELETE /identity/v3/projects/fcbf2a2e4a4a4ee0b44b082aae9d1b4e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:10.655832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:10.656628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:10.656919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:10.675746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:10.677569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:10.735255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 886/1787] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:10.743822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:10.744131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:10.744399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:10.763681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:10.764883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:10.773357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 902/1788] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:10.778535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:10.788020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee26f3-6801-43c0-830a-ff2fd8cb4e05 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:10.792581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:10.793230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:10.793519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:10.793798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:10.794518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:10.794831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:10.796475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:10.809073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 887/1789] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:10.813184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:10.822731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395f9a-4736-429e-8076-e79355dfdbab None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:10.827346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:10.828021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:10.828306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:10.828583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:10.829273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:10.831150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:10.923533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 903/1790] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:10 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:10.928778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:10.949616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86fbd0-a7ab-437a-89c5-08f16cfc4eab admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.009358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.009930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.010217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.010498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.011229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.013219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.099012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 888/1791] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:10 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:11.103027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.113247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a13e8-3b78-43b0-810c-0769f5411a41 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.118453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.119104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.119390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.119738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.120462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.122126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.132375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 904/1792] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:11.136077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.146146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12560dca-eaf1-40ae-b449-6942ffaac7ee admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.151038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.151724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.152013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.152297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.153021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.154623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a595b71-9194-4230-a35b-77fd9f990309 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.165080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 889/1793] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:11.168935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.179501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa7f3d-b82e-43ae-a9f6-0aa058b08448 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.184159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.185009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.185295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.185572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] PATH_INFO: `/v3/projects/e0de31cc77c94f408c4663f34323cf7f/users/a0be720fd4944127a42b1fc8147d3579/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.199612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0de31cc77c94f408c4663f34323cf7f, user_id=a0be720fd4944127a42b1fc8147d3579, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.202275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.293658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 905/1794] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:11 2022] PUT /identity/v3/projects/e0de31cc77c94f408c4663f34323cf7f/users/a0be720fd4944127a42b1fc8147d3579/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:11.304947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.305473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.305905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.343365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] MFA Rules not processed for user `a0be720fd4944127a42b1fc8147d3579`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:11.344647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:11.406626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 890/1795] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:11.411603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.471943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc6350-5408-491c-aac0-97d20ea34286 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.477307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.477964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.478253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.478533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.479222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.481209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.557046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 906/1796] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:11 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:11.561074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.571630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc07a1a-0778-4c0c-8f6d-4ff0887a4429 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.625685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.626354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.626634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.626908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.627640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.629583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.692913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 891/1797] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:11 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:11.696781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.706814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2738c3-8829-478b-bb3b-30436f157312 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.711938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.712634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.712875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.713154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.713863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.715451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.726133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 907/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:11.729963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.739631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11ef8b-8a8d-4929-ac89-417b27a629d0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.744107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.744973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.745254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.745530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] PATH_INFO: `/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a/users/8bdf9a67c1b545e7ae02a00419856d71/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.759391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20ac1fa42c64eaa82c93cbb7da2721a, user_id=8bdf9a67c1b545e7ae02a00419856d71, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.762076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.836672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 892/1799] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:11 2022] PUT /identity/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a/users/8bdf9a67c1b545e7ae02a00419856d71/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:11.840454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.850190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e01c-7281-4e65-8c0f-6e805092472f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.903072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.903747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.904029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.904305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.905010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.906586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28715e2-42ee-4718-8e22-221fab162409 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.916449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 908/1800] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:11.920538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:11.930780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249b6f-5647-4d49-9138-cccf4365e44b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:11.935334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:11.936244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.936536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.936816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] PATH_INFO: `/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a/users/8bdf9a67c1b545e7ae02a00419856d71/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.938799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20ac1fa42c64eaa82c93cbb7da2721a, user_id=8bdf9a67c1b545e7ae02a00419856d71, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:11.941985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:11.952022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 893/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:11 2022] PUT /identity/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a/users/8bdf9a67c1b545e7ae02a00419856d71/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:11.962570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:11.962905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:11.963135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:11.988766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] MFA Rules not processed for user `8bdf9a67c1b545e7ae02a00419856d71`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:11.989992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:12.054871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 909/1802] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:12.067184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:12.068884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:12.124709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2c1e-3198-4fd4-b32c-9ebd1ed6a478 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:12.128314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:12.129494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:12.129784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:12.130065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:12.138865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:12.140321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:12.151183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 894/1803] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:13.045165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:13.054728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa51d-764f-4b55-8dc1-81c42b00971e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:13.059273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bdf9a67c1b545e7ae02a00419856d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:13.060023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:13.060311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:13.060595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:13.061315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:13.061627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:13.063324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:13.074562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 910/1804] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:13.078600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:13.088400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd947fa-19e9-4e46-a7b2-ac1433838654 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:13.092987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bdf9a67c1b545e7ae02a00419856d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:13.093637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:13.093930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:13.094222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:13.094926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:13.096871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:13.179990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 895/1805] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:13 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:13.184028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:13.194331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a1e9e-5fff-4ca4-b26e-278b1fb46d89 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:13.248589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bdf9a67c1b545e7ae02a00419856d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:13.249172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:13.249469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:13.249746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:13.250457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:13.250768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:13.252401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:13.263894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 911/1806] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:13.308264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:13.318937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a474c0-95fa-4df1-9c5c-d0b4eeefe3d6 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:13.323577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bdf9a67c1b545e7ae02a00419856d71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:13.324536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:13.324828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:13.325107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] PATH_INFO: `/v3/projects/ebd613fef6794c1fab0a5aaf56f9702f` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:13.326279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ebd613fef6794c1fab0a5aaf56f9702f)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:13.328213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:13.460042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd613fef6794c1fab0a5aaf56f9702f', 'request_id': 'req-26df09c1-fbb8-4e9c-9117-750227b12e03'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:13.584554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd613fef6794c1fab0a5aaf56f9702f', 'request_id': 'req-26df09c1-fbb8-4e9c-9117-750227b12e03'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:13.590319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd613fef6794c1fab0a5aaf56f9702f', 'request_id': 'req-26df09c1-fbb8-4e9c-9117-750227b12e03'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:13.600993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] The token cache is being invalidate because project ebd613fef6794c1fab0a5aaf56f9702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:13.601280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:13.601907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-26df09c1-fbb8-4e9c-9117-750227b12e03 tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:13.603431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 896/1807] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:13 2022] DELETE /identity/v3/projects/ebd613fef6794c1fab0a5aaf56f9702f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:14.157665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:14.159400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:14.225891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82c7c9-9a3d-4e65-8192-0a6ba6b6e31c tempest-VolumeQuotaClassesTest-1757312744 tempest-VolumeQuotaClassesTest-1757312744-project-admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:14.278117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:14.278957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:14.279243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:14.279544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] PATH_INFO: `/v3/users/a0be720fd4944127a42b1fc8147d3579` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:14.280776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0be720fd4944127a42b1fc8147d3579)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:14.282727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:14.460644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0be720fd4944127a42b1fc8147d3579'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:14.461368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0be720fd4944127a42b1fc8147d3579'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:14.462036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0be720fd4944127a42b1fc8147d3579'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:14.515616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0be720fd4944127a42b1fc8147d3579'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:14.528693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0be720fd4944127a42b1fc8147d3579'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:14.545245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 912/1808] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:14 2022] DELETE /identity/v3/users/a0be720fd4944127a42b1fc8147d3579 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:14.549564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:14.550004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:14.550578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:14.569406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:14.570945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:14.635615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 897/1809] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:14.644912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:14.646860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:14.713568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe1e1-557e-4cbe-951a-bcf25260db46 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:14.717432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:14.718135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:14.718400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:14.718673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:14.728410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:14.729840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:14.739102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 913/1810] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:15.112434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:15.113918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:15.134939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d449a6-c1fc-49a8-9835-aa8c3be981e8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:15.152665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:15.153768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:15.153868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:15.154121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] PATH_INFO: `/v3/projects/e0de31cc77c94f408c4663f34323cf7f` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:15.157455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0de31cc77c94f408c4663f34323cf7f)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:15.159715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:15.256898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0de31cc77c94f408c4663f34323cf7f', 'request_id': 'req-8c144eb3-7312-4747-b0cc-615b115838c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.293809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0de31cc77c94f408c4663f34323cf7f', 'request_id': 'req-8c144eb3-7312-4747-b0cc-615b115838c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.299969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0de31cc77c94f408c4663f34323cf7f', 'request_id': 'req-8c144eb3-7312-4747-b0cc-615b115838c8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.312219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] The token cache is being invalidate because project e0de31cc77c94f408c4663f34323cf7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:15.312439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.313180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.314763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 898/1811] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:15 2022] DELETE /identity/v3/projects/e0de31cc77c94f408c4663f34323cf7f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:15.318955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:15.329088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bd33-10e1-4fb6-9bef-32560d30bf0b service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:15.385251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:15.386112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:15.386394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:15.386662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] PATH_INFO: `/v3/users/8bdf9a67c1b545e7ae02a00419856d71` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:15.387861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdf9a67c1b545e7ae02a00419856d71)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:15.390201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:15.604026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdf9a67c1b545e7ae02a00419856d71'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.604711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdf9a67c1b545e7ae02a00419856d71'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.605323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdf9a67c1b545e7ae02a00419856d71'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.676215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdf9a67c1b545e7ae02a00419856d71'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.689312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e2868f6-5747-4a85-8d55-d18b86b69399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdf9a67c1b545e7ae02a00419856d71'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:15.701633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 914/1812] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:15 2022] DELETE /identity/v3/users/8bdf9a67c1b545e7ae02a00419856d71 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:16.158548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:16.160105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:16.172728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144eb3-7312-4747-b0cc-615b115838c8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:16.236638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:16.238720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.238720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.238720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] PATH_INFO: `/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.240343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20ac1fa42c64eaa82c93cbb7da2721a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:16.242334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:16.378956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'request_id': 'req-86859a0a-423f-4e47-ac61-7d2fafead78f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:16.487977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'request_id': 'req-86859a0a-423f-4e47-ac61-7d2fafead78f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:16.499146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20ac1fa42c64eaa82c93cbb7da2721a', 'request_id': 'req-86859a0a-423f-4e47-ac61-7d2fafead78f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:16.512366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] The token cache is being invalidate because project a20ac1fa42c64eaa82c93cbb7da2721a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:16.512902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:16.513752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-86859a0a-423f-4e47-ac61-7d2fafead78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:16.520646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 899/1813] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:16 2022] DELETE /identity/v3/projects/a20ac1fa42c64eaa82c93cbb7da2721a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:16.522995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f02c-0335-453d-861f-797c2c6ad991 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.523461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f02c-0335-453d-861f-797c2c6ad991 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.523605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9f02c-0335-453d-861f-797c2c6ad991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.546124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-7fa9f02c-0335-453d-861f-797c2c6ad991 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:16.547968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7fa9f02c-0335-453d-861f-797c2c6ad991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:16.549076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.549373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.549735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.573719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] MFA Rules not processed for user `69b4c5f51c5943ef95fd751c67d2e901`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:16.575686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:16.620477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 915/1814] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:16.629306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.629523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.629879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.639564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 900/1815] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:16.649033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:16.650230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:16.659155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 916/1816] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:16.664470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:16.676913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b2a5f-77f7-439f-86e8-d87735f26414 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:16.682196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:16.682789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.683140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.683549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.684399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:16.684803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:16.686740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:16.716290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 901/1817] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:16.721248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:16.731619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf592b-9951-476b-8fd1-060d5151c45f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:16.736773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:16.737434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.737720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.738001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.738780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:16.740786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:16.826558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 917/1818] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:16 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:16.830828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:16.841882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbd31b-6dbb-40aa-a69a-a91ae312a81e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:16.909314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:16.911008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:16.911008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:16.911008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:16.912367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:16.914347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:16.997974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 902/1819] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:16 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:17.002371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.017611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4718c6-6f08-4e48-9ccb-161bc1945f41 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.024670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.025878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.027382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.027382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.028026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.029811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.046504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 918/1820] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:17.051459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.063457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eae61-96be-4402-a25e-293e7241b7b3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.074997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.074997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.074997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.074997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.075606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.078978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3c76-6a49-4868-8276-f40eef2c1a59 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.093715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 903/1821] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:17.109846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.123423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5f91a-3c4e-4eb9-9c3a-50136c1da800 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.128858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.132419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.132419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.132419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] PATH_INFO: `/v3/projects/fb04ab43390f45fc921ae630d6edae78/users/44bf42474f1e479982f414184e424f57/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.147655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb04ab43390f45fc921ae630d6edae78, user_id=44bf42474f1e479982f414184e424f57, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.150438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.288659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 919/1822] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:17 2022] PUT /identity/v3/projects/fb04ab43390f45fc921ae630d6edae78/users/44bf42474f1e479982f414184e424f57/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:17.298958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.299460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.299596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.336203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] MFA Rules not processed for user `44bf42474f1e479982f414184e424f57`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:17.337840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:17.441943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.443382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 904/1823] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:17.515986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dccc8-a6b1-450e-9a51-4db8f443b176 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.523703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.523703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.523703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.523703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.524677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.528639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.628575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 920/1824] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:17 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:17.633456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.650892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9297-4955-44b3-a34b-aa51cde4b2a6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.776920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.777611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.788255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.788255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.788255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.788255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.876954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 905/1825] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:17 2022] POST /identity/v3/users => generated 303 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:17.880749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.890786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc098ac-6268-4737-ae16-222322d5c6cb admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.895335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.896015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.896304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.896582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.897299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.898930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.909383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 921/1826] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:17.913987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.924444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a446af-58db-4c7e-8906-2bf60bb60111 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.930325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.935624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.935624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.935624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] PATH_INFO: `/v3/projects/15863dd0d39d4c319054ce6017151b9d/users/0655a20dfec349ba877dd0b28b7ab5a7/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.943179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:17.945317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:17.948820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15863dd0d39d4c319054ce6017151b9d, user_id=0655a20dfec349ba877dd0b28b7ab5a7, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.951995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:17.959674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9986d-b05b-4ecd-b6e2-069ba7983a39 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:17.964652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:17.966280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:17.966280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:17.966280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] PATH_INFO: `/v3/users/0fe4db405646440db99f2186dcd205f5` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:17.967454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe4db405646440db99f2186dcd205f5)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:17.970146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.060583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 906/1827] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:17 2022] PUT /identity/v3/projects/15863dd0d39d4c319054ce6017151b9d/users/0655a20dfec349ba877dd0b28b7ab5a7/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:18.064453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:18.125983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe4db405646440db99f2186dcd205f5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:18.126216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f168bb-2595-4df4-b69c-93548562353f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:18.126705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe4db405646440db99f2186dcd205f5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:18.127327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe4db405646440db99f2186dcd205f5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:18.130665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:18.131328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.131649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.131929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.132658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:18.134300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.144229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 907/1828] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:18.148837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:18.150441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.163772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a285-b1ae-42ab-b264-fb36604d0053 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:18.168370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:18.169332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.169618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.169904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] PATH_INFO: `/v3/projects/15863dd0d39d4c319054ce6017151b9d/users/0655a20dfec349ba877dd0b28b7ab5a7/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.171922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15863dd0d39d4c319054ce6017151b9d, user_id=0655a20dfec349ba877dd0b28b7ab5a7, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:18.174552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffacbf-ad84-4855-a438-b06a82ad699b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.184965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 908/1829] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:18 2022] PUT /identity/v3/projects/15863dd0d39d4c319054ce6017151b9d/users/0655a20dfec349ba877dd0b28b7ab5a7/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:18.195041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.195339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.195655 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.200653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe4db405646440db99f2186dcd205f5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:18.214601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5c47f09e-1f17-47f9-9596-2da2855f7d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe4db405646440db99f2186dcd205f5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:18.225559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] MFA Rules not processed for user `0655a20dfec349ba877dd0b28b7ab5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:18.226804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.228569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 922/1830] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:17 2022] DELETE /identity/v3/users/0fe4db405646440db99f2186dcd205f5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:18.232849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.233144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.237675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.251578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:18.252804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.294136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 909/1831] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:18.308722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:18.310184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.316099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 923/1832] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:18.326281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:18.327712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.365455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15597fe6-5182-4f5b-b3fa-14abe9fe60c3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:18.369109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:18.369748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.370029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.370303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.379795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:18.381926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.382942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc11ff-f7e8-4518-b363-025df5ea75aa None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:18.386617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:18.387266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.388237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.388534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.391662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 910/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:18.397975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:18.399410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.408843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 924/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:18.457286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:18.470485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259403-d4ec-446e-bae5-773353cb1f5a service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:18.476202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:18.477021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:18.477399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:18.477705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:18.481466 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:18.556049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:18.557513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:18.568096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 911/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:18.998087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:19.000367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:19.015028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeccb5-1b4d-4c5a-b70e-b42b5f27d15e service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:19.020191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:19.023175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:19.023686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:19.024120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] PATH_INFO: `/v3/projects/952b158d76784d6dbabdcca7e317913d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:19.025580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952b158d76784d6dbabdcca7e317913d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:19.027987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:19.157307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952b158d76784d6dbabdcca7e317913d', 'request_id': 'req-91fc31a0-5a60-4343-ab04-69f4c4246864'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.265055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952b158d76784d6dbabdcca7e317913d', 'request_id': 'req-91fc31a0-5a60-4343-ab04-69f4c4246864'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.282221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952b158d76784d6dbabdcca7e317913d', 'request_id': 'req-91fc31a0-5a60-4343-ab04-69f4c4246864'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.296825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] The token cache is being invalidate because project 952b158d76784d6dbabdcca7e317913d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:19.297124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.298271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.302873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 925/1836] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:18 2022] DELETE /identity/v3/projects/952b158d76784d6dbabdcca7e317913d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:19.307251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:19.321928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3588240-c1ef-4312-ae6a-4890112a3be3 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:19.382630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:19.383579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:19.383870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:19.384158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] PATH_INFO: `/v3/users/07854253fffc4935b6eeb402a49e4a9c` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:19.385410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=07854253fffc4935b6eeb402a49e4a9c)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:19.387359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:19.545684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07854253fffc4935b6eeb402a49e4a9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.546589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07854253fffc4935b6eeb402a49e4a9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.547266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07854253fffc4935b6eeb402a49e4a9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.607684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07854253fffc4935b6eeb402a49e4a9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.614843 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07854253fffc4935b6eeb402a49e4a9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:19.632312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 912/1837] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:19 2022] DELETE /identity/v3/users/07854253fffc4935b6eeb402a49e4a9c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:20.192234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:20.194361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:20.230662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc31a0-5a60-4343-ab04-69f4c4246864 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:20.294829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:20.295904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:20.296195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:20.299762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] PATH_INFO: `/v3/projects/922e1dc910ca4bd5be215926f1584fd3` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:20.299762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922e1dc910ca4bd5be215926f1584fd3)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:20.300441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:20.355890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:20.358110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:20.373335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3635c80-ce5d-455f-b6d3-c6967b7f1cdd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:20.380449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:20.380449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:20.380449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:20.380449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] PATH_INFO: `/v3/users/073e5f840eeb4318bf42c85a260ade73` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:20.381465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=073e5f840eeb4318bf42c85a260ade73)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:20.383575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:20.613775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922e1dc910ca4bd5be215926f1584fd3', 'request_id': 'req-03a72c60-c678-4be7-9ffa-881fb311c5f3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.847666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922e1dc910ca4bd5be215926f1584fd3', 'request_id': 'req-03a72c60-c678-4be7-9ffa-881fb311c5f3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.855144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922e1dc910ca4bd5be215926f1584fd3', 'request_id': 'req-03a72c60-c678-4be7-9ffa-881fb311c5f3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.866677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] The token cache is being invalidate because project 922e1dc910ca4bd5be215926f1584fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:20.866890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.867765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-03a72c60-c678-4be7-9ffa-881fb311c5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.870058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 926/1838] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:20 2022] DELETE /identity/v3/projects/922e1dc910ca4bd5be215926f1584fd3 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:20.874447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbadf-236d-47f5-b951-48664a87c3ce None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:20.874762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbadf-236d-47f5-b951-48664a87c3ce None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:20.875049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbadf-236d-47f5-b951-48664a87c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:20.896454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-485fbadf-236d-47f5-b951-48664a87c3ce None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:20.898892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-485fbadf-236d-47f5-b951-48664a87c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:20.945516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073e5f840eeb4318bf42c85a260ade73'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.948585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073e5f840eeb4318bf42c85a260ade73'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:20.952338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073e5f840eeb4318bf42c85a260ade73'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.007570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 927/1839] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:21.016229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.016668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.017051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.048091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:21.048091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:21.054789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073e5f840eeb4318bf42c85a260ade73'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.064985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073e5f840eeb4318bf42c85a260ade73'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.067028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 928/1840] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:21.069640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.088346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63002cfb-59ee-4eb9-9811-b1241a47e952 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.096295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.097118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.097504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.097775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 913/1841] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:20 2022] DELETE /identity/v3/users/073e5f840eeb4318bf42c85a260ade73 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:21.098185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.099619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:21.100089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.101915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.117104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 929/1842] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:21.121286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.184930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dace1-1fe4-40e6-a6ab-54f97e9ab71e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.192749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.193604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.193992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.194375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.195284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.197444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.286480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 914/1843] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:21 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:21.288331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.298261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77c6af-9767-4618-abf3-d9beeac9453a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.352940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.353648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.353929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.354208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.354931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.356887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.413983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.416607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:21.433770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 930/1844] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:21 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:21.438950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.441649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576662-1b31-4b85-a87b-70fbeb2fc576 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.449808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.450702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.450989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.451888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] PATH_INFO: `/v3/projects/ac0acb2cd8984a35bf294aa2fdc31a94` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.454054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0acb2cd8984a35bf294aa2fdc31a94)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.456060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.464112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e442-6df9-4f6d-a2ad-1437418977b7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.478957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.487543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.487810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.488094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.488834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.490499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.501753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 931/1845] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:21.506916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.517503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0142a-fb68-4b31-8219-174c89e66ad6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.523078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.523823 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.524113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.524391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.525111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.526744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.540755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 932/1846] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:21.544819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.554856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b19ca-be13-4c24-9150-a6d8a3f15475 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.560583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.561537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.561826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.562103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] PATH_INFO: `/v3/projects/b29a57789f514b988205c990876b1b1b/users/17f457a15f4c4c76a6d1a1c4b5e70f2e/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.576950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29a57789f514b988205c990876b1b1b, user_id=17f457a15f4c4c76a6d1a1c4b5e70f2e, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.581407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac87160-3e2a-4866-9fe6-7ee544019d82 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.694813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 933/1847] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:21 2022] PUT /identity/v3/projects/b29a57789f514b988205c990876b1b1b/users/17f457a15f4c4c76a6d1a1c4b5e70f2e/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:21.703723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0acb2cd8984a35bf294aa2fdc31a94', 'request_id': 'req-6d433a09-5d96-4470-a126-28f73159180b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.705348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.705643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.705935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.732313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] MFA Rules not processed for user `17f457a15f4c4c76a6d1a1c4b5e70f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:21.733574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:21.761690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0acb2cd8984a35bf294aa2fdc31a94', 'request_id': 'req-6d433a09-5d96-4470-a126-28f73159180b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.762876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0acb2cd8984a35bf294aa2fdc31a94', 'request_id': 'req-6d433a09-5d96-4470-a126-28f73159180b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.776672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] The token cache is being invalidate because project ac0acb2cd8984a35bf294aa2fdc31a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:21.777014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.777679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:21.781137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 915/1848] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:21 2022] DELETE /identity/v3/projects/ac0acb2cd8984a35bf294aa2fdc31a94 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:21.785672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.787093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:21.826493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 934/1849] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:21.830838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:21.832438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:21.860886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433a09-5d96-4470-a126-28f73159180b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.866739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.867803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.868180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.868714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] PATH_INFO: `/v3/users/5378850191f84732ad86360ef2d9b1f8` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.869893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5378850191f84732ad86360ef2d9b1f8)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.871882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:21.910935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945de3b5-f699-48d8-8b04-21535d56a6cc None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:21.915680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:21.916332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:21.916615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:21.916885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:21.917695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:21.919629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.011801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 935/1850] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:21 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:22.015652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.097568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d63d-3dc7-497b-80f9-9c270a0aeba2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.100386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5378850191f84732ad86360ef2d9b1f8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.101286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5378850191f84732ad86360ef2d9b1f8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.102092 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5378850191f84732ad86360ef2d9b1f8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.105711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.106415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.106707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.106992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.107824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.109934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.184124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5378850191f84732ad86360ef2d9b1f8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.194083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5378850191f84732ad86360ef2d9b1f8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.215528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 916/1851] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:21 2022] DELETE /identity/v3/users/5378850191f84732ad86360ef2d9b1f8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:22.232455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 936/1852] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:22 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:22.233629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.235331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:22.306609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e750e-a056-4b5e-b245-c5fadd11270e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.311873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.312420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.312705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.312979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.313703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.315345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.330695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 917/1853] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:22.333751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.345037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d29e0-0081-495b-9b4f-1b4430b03d45 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.351098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.352034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.352323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.352603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] PATH_INFO: `/v3/projects/43520606bfed4e6696d29264bd8cc0a2/users/be8bc7ffe5ff477bb2524a4c500c54f4/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.370848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43520606bfed4e6696d29264bd8cc0a2, user_id=be8bc7ffe5ff477bb2524a4c500c54f4, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.373648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.433044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 937/1854] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:22 2022] PUT /identity/v3/projects/43520606bfed4e6696d29264bd8cc0a2/users/be8bc7ffe5ff477bb2524a4c500c54f4/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:22.436953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.447984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accbb82-74d7-4ab1-b8c1-534b5f6528d1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.506145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.506818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.507120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.507392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.508238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.510141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.523980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 918/1855] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:22.525598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.535806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337b1c-4415-48ba-a677-8ffd9f65ecd4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.542299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.543286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.543666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.543960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] PATH_INFO: `/v3/projects/43520606bfed4e6696d29264bd8cc0a2/users/be8bc7ffe5ff477bb2524a4c500c54f4/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.545931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43520606bfed4e6696d29264bd8cc0a2, user_id=be8bc7ffe5ff477bb2524a4c500c54f4, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.548605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb7d0-9390-4f14-95e6-1749ea1b9928 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.559888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 938/1856] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:22 2022] PUT /identity/v3/projects/43520606bfed4e6696d29264bd8cc0a2/users/be8bc7ffe5ff477bb2524a4c500c54f4/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:22.569010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.571153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:22.571769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1937-3792-4532-8438-d56430555f66 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.572175 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1937-3792-4532-8438-d56430555f66 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.572394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1937-3792-4532-8438-d56430555f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.586374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c40f-1c73-4365-84f2-a8676064f68a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.617641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-66fc1937-3792-4532-8438-d56430555f66 None None] MFA Rules not processed for user `be8bc7ffe5ff477bb2524a4c500c54f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:22.619194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-66fc1937-3792-4532-8438-d56430555f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:22.648945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.649971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.650332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.650804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] PATH_INFO: `/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.652122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59e64bb1cd04b5eb3392f6261909a9b)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.654495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.693248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 939/1857] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:22.704897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1937-3792-4532-8438-d56430555f66 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.706283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-66fc1937-3792-4532-8438-d56430555f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:22.763490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1937-3792-4532-8438-d56430555f66 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:22.775067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59e64bb1cd04b5eb3392f6261909a9b', 'request_id': 'req-c76de415-ffd9-40b9-b624-9a5d748b62cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.816720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:22.817517 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.817834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.818169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.835643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59e64bb1cd04b5eb3392f6261909a9b', 'request_id': 'req-c76de415-ffd9-40b9-b624-9a5d748b62cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.842437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59e64bb1cd04b5eb3392f6261909a9b', 'request_id': 'req-c76de415-ffd9-40b9-b624-9a5d748b62cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.854569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] The token cache is being invalidate because project d59e64bb1cd04b5eb3392f6261909a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:22.854834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.855907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c76de415-ffd9-40b9-b624-9a5d748b62cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:22.857523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 919/1858] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:22 2022] DELETE /identity/v3/projects/d59e64bb1cd04b5eb3392f6261909a9b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:22.862128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b5fc-8e35-4740-b837-706785860d84 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.862527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b5fc-8e35-4740-b837-706785860d84 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.862960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b5fc-8e35-4740-b837-706785860d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.881945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:22.882379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4a61b5fc-8e35-4740-b837-706785860d84 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:22.883426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:22.883765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4a61b5fc-8e35-4740-b837-706785860d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:22.893397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 940/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:22.960424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:22.971833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 920/1860] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:22.980272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:22.980538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:22.980818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:22.999888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:23.005830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.009887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 921/1861] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:23.014015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.023874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f671-f95c-40c7-97ae-86f4391e61b6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.028951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.029618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.029910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.030214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.031123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:23.031437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.035539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f063bd-ed7b-41eb-9343-5663f2444299 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.035677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.039305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.040834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.041290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.041540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] PATH_INFO: `/v3/users/17f457a15f4c4c76a6d1a1c4b5e70f2e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.042873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f457a15f4c4c76a6d1a1c4b5e70f2e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.051359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 922/1862] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:23.051749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.052443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.062400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0207b60-0b3b-4c7d-b958-d02d35164baa admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.067298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.068627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.069118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.069414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.070114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.072078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.186640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 923/1863] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:23.190340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.258089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faf156-9e58-431b-987e-8dcbfa1dbc7b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.263654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.264374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.264664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.264949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.265678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.267669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.275700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f457a15f4c4c76a6d1a1c4b5e70f2e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:23.277250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f457a15f4c4c76a6d1a1c4b5e70f2e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:23.277870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f457a15f4c4c76a6d1a1c4b5e70f2e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:23.369455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 924/1864] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:23 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:23.374280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.379049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f457a15f4c4c76a6d1a1c4b5e70f2e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:23.383329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.396817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-341e9e49-9b4d-4bad-9041-bf131b73d29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f457a15f4c4c76a6d1a1c4b5e70f2e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:23.409332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b78c-df50-44d3-ab56-438a77001407 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.413957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 941/1865] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:22 2022] DELETE /identity/v3/users/17f457a15f4c4c76a6d1a1c4b5e70f2e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:23.417186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.417893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.418318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.419081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.419392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.421248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.421496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.421861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.422158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.438594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 925/1866] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:23.439765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.446063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:23.447384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.451261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04068d44-19c1-4b25-af8c-1b6fd9702c1b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.515636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 942/1867] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:23.525365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.526882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.531824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.532673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.532933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.533354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.534098 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.535858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.551646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 926/1868] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:23.558770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.570219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db3ab-1d1b-448f-8876-502aecff7723 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.579354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.580432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.580919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.584760 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] PATH_INFO: `/v3/projects/4ea7944b5886442db6240d961a37fa6b/users/195312b0498d4622ae67f79463e184cd/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.587649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd753a-53c7-4b01-b236-efea3e8beb20 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.591343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.592022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.592313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.592660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.603134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.604777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8c7dd-3dac-4a06-8788-ebda318aec07 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.605040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea7944b5886442db6240d961a37fa6b, user_id=195312b0498d4622ae67f79463e184cd, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.607850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.615137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 943/1869] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:23.699669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 927/1870] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:23 2022] PUT /identity/v3/projects/4ea7944b5886442db6240d961a37fa6b/users/195312b0498d4622ae67f79463e184cd/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:23.711598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.711958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.712308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.742188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] MFA Rules not processed for user `195312b0498d4622ae67f79463e184cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:23.743597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.815493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 944/1871] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:23.820971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.886872 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138c80b-022d-439d-b8b0-c6a627835f2a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.891695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.892352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.892636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.892908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.893601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.895592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:23.945131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:23.946540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:23.961031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b94c-b16e-4b92-a10d-bc802c5d3e2d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:23.965686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:23.966647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:23.966931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:23.967212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] PATH_INFO: `/v3/users/44bf42474f1e479982f414184e424f57` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:23.968437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bf42474f1e479982f414184e424f57)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:23.970642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.004354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 928/1872] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:24.006045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.071016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdc77-e626-4a14-b878-80f5f52234ff admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.076270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.076947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.077234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.077515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.078209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.080193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.158477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 929/1873] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:24 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:24.164526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.175508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6822e2c-0fac-4873-b121-bbc7bc98d708 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.181859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.182661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.183021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.183400 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.184347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.185902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bf42474f1e479982f414184e424f57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.186273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.189421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bf42474f1e479982f414184e424f57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.190025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bf42474f1e479982f414184e424f57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.213277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 930/1874] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:24.214785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.216564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.234265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f63e1-5bd5-4309-a5bc-f0f7167e23ad admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.241860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.242618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.242908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.243188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] PATH_INFO: `/v3/projects/8341583a02cd4ae5a17985466c66040f/users/6ed740b976f2416bada65c7e90710382/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.259256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bf42474f1e479982f414184e424f57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.273383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8341583a02cd4ae5a17985466c66040f, user_id=6ed740b976f2416bada65c7e90710382, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.273383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c35ad-59f3-44c9-8ca8-5f578e7c67e4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.276012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bf42474f1e479982f414184e424f57'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.289116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 945/1875] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:23 2022] DELETE /identity/v3/users/44bf42474f1e479982f414184e424f57 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:24.289877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.292097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.355239 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270bb16-a2c3-49e1-8927-2a0829756bd2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.356530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 931/1876] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:24 2022] PUT /identity/v3/projects/8341583a02cd4ae5a17985466c66040f/users/6ed740b976f2416bada65c7e90710382/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:24.359725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.359725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.359725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.375926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:24.377226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.410102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.410963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.411251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.411648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] PATH_INFO: `/v3/projects/b29a57789f514b988205c990876b1b1b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.412788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29a57789f514b988205c990876b1b1b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.414702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.439584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 932/1877] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:24.439584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.448046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53969aaf-3926-4ca7-be8a-7c81620f7219 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.452893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.453642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.453993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.454274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.455001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.456649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.466817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 933/1878] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:24.467559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.469239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.521514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29a57789f514b988205c990876b1b1b', 'request_id': 'req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.527727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d349-d560-45a2-a4c5-def4d7d4652c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.575695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.576344 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.576625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.576898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.578910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29a57789f514b988205c990876b1b1b', 'request_id': 'req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.586531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29a57789f514b988205c990876b1b1b', 'request_id': 'req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.599752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] The token cache is being invalidate because project b29a57789f514b988205c990876b1b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:24.600056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.600718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.605554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 946/1879] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:24 2022] DELETE /identity/v3/projects/b29a57789f514b988205c990876b1b1b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:24.605554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.606904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.648173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.650393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.665977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 934/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:24.666887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.677779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c092-3395-4257-87bb-afb7027172e5 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.680619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feca5c3-dcb8-4454-ae09-d5c7289b6f8a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.683193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.684193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.684598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.684899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] PATH_INFO: `/v3/users/be8bc7ffe5ff477bb2524a4c500c54f4` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.685691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.686093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8bc7ffe5ff477bb2524a4c500c54f4)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.686601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.686882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.687156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] PATH_INFO: `/v3/projects/8341583a02cd4ae5a17985466c66040f/users/6ed740b976f2416bada65c7e90710382/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.688378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.689516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8341583a02cd4ae5a17985466c66040f, user_id=6ed740b976f2416bada65c7e90710382, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.692204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5563a0a-d168-4806-90a2-b678c2e763ce admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.704768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 947/1881] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:24 2022] PUT /identity/v3/projects/8341583a02cd4ae5a17985466c66040f/users/6ed740b976f2416bada65c7e90710382/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:24.716086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.716486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.716894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.744732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] MFA Rules not processed for user `6ed740b976f2416bada65c7e90710382`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:24.746061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.821164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 948/1882] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:24.826547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:24.828314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.872893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8bc7ffe5ff477bb2524a4c500c54f4'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.873611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8bc7ffe5ff477bb2524a4c500c54f4'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.874250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8bc7ffe5ff477bb2524a4c500c54f4'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.884967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485e643-680e-4ae1-a1d0-81b279e09b34 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:24.888767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:24.889415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:24.889702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:24.889979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:24.891914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:24.952593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:24.954051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:24.955712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8bc7ffe5ff477bb2524a4c500c54f4'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.963924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8bc7ffe5ff477bb2524a4c500c54f4'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:24.965024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 949/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:24.985411 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 935/1884] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:24 2022] DELETE /identity/v3/users/be8bc7ffe5ff477bb2524a4c500c54f4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:25.287056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:25.287347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:25.362976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67355-cac3-47ca-abc4-8b03b873eeee service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:25.419032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:25.419918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.420206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.420504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] PATH_INFO: `/v3/projects/fb04ab43390f45fc921ae630d6edae78` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.421682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb04ab43390f45fc921ae630d6edae78)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:25.423910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:25.460539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:25.464396 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:25.475586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecaf76-39db-4e18-98f0-152e30c99cb1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:25.480305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:25.481225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.481510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.481829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] PATH_INFO: `/v3/projects/43520606bfed4e6696d29264bd8cc0a2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.483131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43520606bfed4e6696d29264bd8cc0a2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:25.485022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:25.538897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb04ab43390f45fc921ae630d6edae78', 'request_id': 'req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.619275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43520606bfed4e6696d29264bd8cc0a2', 'request_id': 'req-1de89d82-6986-44dd-b561-1fcfd714e562'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.630415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb04ab43390f45fc921ae630d6edae78', 'request_id': 'req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.637144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb04ab43390f45fc921ae630d6edae78', 'request_id': 'req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.653003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] The token cache is being invalidate because project fb04ab43390f45fc921ae630d6edae78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:25.653292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.654445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.656042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 950/1885] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:25 2022] DELETE /identity/v3/projects/fb04ab43390f45fc921ae630d6edae78 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:25.659807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:25.661121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:25.723771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e7d5-3bac-4ed8-b34c-aa6ed4c4818d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:25.733334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43520606bfed4e6696d29264bd8cc0a2', 'request_id': 'req-1de89d82-6986-44dd-b561-1fcfd714e562'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.739615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43520606bfed4e6696d29264bd8cc0a2', 'request_id': 'req-1de89d82-6986-44dd-b561-1fcfd714e562'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.750786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] The token cache is being invalidate because project 43520606bfed4e6696d29264bd8cc0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:25.751064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.751745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1de89d82-6986-44dd-b561-1fcfd714e562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.753282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 936/1886] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:25 2022] DELETE /identity/v3/projects/43520606bfed4e6696d29264bd8cc0a2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:25.764508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f8b8-2b42-4259-be10-0d358395624a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.764715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f8b8-2b42-4259-be10-0d358395624a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.765102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f8b8-2b42-4259-be10-0d358395624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.784073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:25.784073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.784073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.784073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] PATH_INFO: `/v3/users/0655a20dfec349ba877dd0b28b7ab5a7` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.784419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0655a20dfec349ba877dd0b28b7ab5a7)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:25.784506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-89c0f8b8-2b42-4259-be10-0d358395624a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:25.785108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-89c0f8b8-2b42-4259-be10-0d358395624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:25.785243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:25.794903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 937/1887] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:25.802796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.803125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.806981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.822757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:25.827881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:25.834772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 938/1888] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:25.838638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:25.847661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08632e-bd04-421b-af2d-275bd5d24671 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:25.852956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:25.853599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.853880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.856640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.856640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:25.856640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:25.856895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:25.868188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 939/1889] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:25.872526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:25.882102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ad716-7755-49a5-9cf5-7f229bab8f12 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:25.886800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:25.887464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:25.891010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:25.891010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:25.891010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:25.891010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:25.981841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0655a20dfec349ba877dd0b28b7ab5a7'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.982524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0655a20dfec349ba877dd0b28b7ab5a7'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.983170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0655a20dfec349ba877dd0b28b7ab5a7'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:25.999331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 940/1890] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:26.003431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.005602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.066881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e18db-3027-473b-8276-73f3550247ee admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.072575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.073257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.073733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.074026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.075018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.076911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.081234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0655a20dfec349ba877dd0b28b7ab5a7'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.104942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0655a20dfec349ba877dd0b28b7ab5a7'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.117682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 951/1891] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:25 2022] DELETE /identity/v3/users/0655a20dfec349ba877dd0b28b7ab5a7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:26.153341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 941/1892] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:26.157486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.227212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3444d-237e-4ebd-95a4-29673d2587db admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.232032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.232698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.232981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.233258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.233973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.235713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.245907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 952/1893] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:26.249887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.260173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a809-a754-460f-9f18-40874802d3b2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.264844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.265495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.265829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.266097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.266822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.268470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913800ea-68e2-49f7-8569-f0fe11adb08a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.278703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 942/1894] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:26.282556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.292930 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d68534-464f-4015-8658-4a3d76b435d5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.298168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.299050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.299337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.299675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] PATH_INFO: `/v3/projects/729058e754f0485ea182611f4390bd1a/users/a100af15eaa646808b3d175c11d6d76e/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.314380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729058e754f0485ea182611f4390bd1a, user_id=a100af15eaa646808b3d175c11d6d76e, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.321536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.412694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 953/1895] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:26 2022] PUT /identity/v3/projects/729058e754f0485ea182611f4390bd1a/users/a100af15eaa646808b3d175c11d6d76e/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:26.428551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.428551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.428551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.453320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] MFA Rules not processed for user `a100af15eaa646808b3d175c11d6d76e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:26.455942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.521309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 943/1896] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:26.528200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.589649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aaacb-010e-4dea-9775-e89c34970e71 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.594314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.595098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.595705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.603094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.603094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.603094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.634564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.636111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.650193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c128-275a-4f7f-9d99-6ce81e727a01 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.654811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.655701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.655986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.656263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] PATH_INFO: `/v3/projects/15863dd0d39d4c319054ce6017151b9d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.657446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15863dd0d39d4c319054ce6017151b9d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.659549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.685479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 954/1897] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:26.689378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.758310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac568-e213-4fe3-8251-60b0c2b6b1e8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.775784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15863dd0d39d4c319054ce6017151b9d', 'request_id': 'req-ff0a178a-eef6-4e94-84d6-fd302554c89d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.825515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.826226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.826512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.826785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.827503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.829478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.853314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15863dd0d39d4c319054ce6017151b9d', 'request_id': 'req-ff0a178a-eef6-4e94-84d6-fd302554c89d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.859627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15863dd0d39d4c319054ce6017151b9d', 'request_id': 'req-ff0a178a-eef6-4e94-84d6-fd302554c89d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.872558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] The token cache is being invalidate because project 15863dd0d39d4c319054ce6017151b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:26.872876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.873524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ff0a178a-eef6-4e94-84d6-fd302554c89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:26.875262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 944/1898] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:26 2022] DELETE /identity/v3/projects/15863dd0d39d4c319054ce6017151b9d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:26.880374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8889fa-23cb-45a1-b92f-2a0b443a9770 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.881653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8889fa-23cb-45a1-b92f-2a0b443a9770 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.881653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8889fa-23cb-45a1-b92f-2a0b443a9770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.898759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9f8889fa-23cb-45a1-b92f-2a0b443a9770 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:26.902929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9f8889fa-23cb-45a1-b92f-2a0b443a9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.903432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 955/1899] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:26.904514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.906374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.915606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 945/1900] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:26.919238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d658e3-0f7e-4ca2-a15a-bec0feae1088 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.920846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.921145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.921448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.923917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.924579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.924869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.925418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.926165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.928457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.938682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 956/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:26.941409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:26.942666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:26.943026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.952875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 946/1902] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:26.954654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43265-f3fb-4dbf-9855-5b9b8efd9d0a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.957088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.959690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.960499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.960625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.960905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.961955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.963709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.966991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b60bb-fcbb-41d5-b02c-718c23f46fc2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:26.972049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:26.972742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:26.972972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:26.973249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:26.974554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:26.974862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:26.975539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 957/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:26.979589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:26.980804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:26.997362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 947/1904] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:26.999893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f89e6-91be-4562-889c-ce8e355c6af5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.003505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.010924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.011944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.012254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.012509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] PATH_INFO: `/v3/projects/f547cdb52e684ba8b2c16c310e7527dc/users/21cc0338d57f4a7d959f40a58b9d7e48/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.016592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972df49-57cd-4d3a-b589-06739a5ec052 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.021340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.022126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.022425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.022709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.023399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.027348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb67a4-7e3c-46a3-b0ec-0ba7a5c0fbf1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.029899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f547cdb52e684ba8b2c16c310e7527dc, user_id=21cc0338d57f4a7d959f40a58b9d7e48, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.032682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.124383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 958/1905] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:26 2022] PUT /identity/v3/projects/f547cdb52e684ba8b2c16c310e7527dc/users/21cc0338d57f4a7d959f40a58b9d7e48/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:27.131991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 948/1906] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/projects => generated 407 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:27.133166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.134828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.135186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.135725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.170328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] MFA Rules not processed for user `21cc0338d57f4a7d959f40a58b9d7e48`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:27.171755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:27.204032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb702f2-0b90-4816-b4c9-b56985931fca admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.253075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 949/1907] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:27.254031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.267675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.268878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.268878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.269086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.270179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.272744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.337621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168dad-2e10-41dd-a63c-26df45da4057 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.342686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.343730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.347647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.347647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.347647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.347647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.397068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 959/1908] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/users => generated 304 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:27.401200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.410807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21280e-85bf-42b6-bce3-6c78b736890f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.416639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.417182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.417467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.417743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.418463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.420113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.447949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 960/1909] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:27.451861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.463185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676791b-59c0-4263-af71-f05759d5aa08 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.469352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.470024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.470327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.470572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.471411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.472948 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.486932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 961/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:27.491829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.492908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 950/1911] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:27.497085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.506113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754dc65-e643-4ba1-bd0c-a2c2e4b930f7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.563361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062bbfe-9744-4f97-99dc-a7387f3eae0f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.568974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.569873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.570159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.570427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.570565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] PATH_INFO: `/v3/projects/07dc5a4ff8474eeb8859a7f746bd362f/users/51bd7aa59b0e4fbba9362d6aa6c587ba/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.571427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.571756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.572048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.572774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.574785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4dea7-6366-43b0-895f-a0d8d59b13e2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.587442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dc5a4ff8474eeb8859a7f746bd362f, user_id=51bd7aa59b0e4fbba9362d6aa6c587ba, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.590146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.707990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 962/1912] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:27 2022] PUT /identity/v3/projects/07dc5a4ff8474eeb8859a7f746bd362f/users/51bd7aa59b0e4fbba9362d6aa6c587ba/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:27.708160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 951/1913] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:27.712309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.716181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.716497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.716776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.745567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] MFA Rules not processed for user `51bd7aa59b0e4fbba9362d6aa6c587ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:27.746778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:27.778340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921d9e4-dd57-4211-801e-12881277f7ae admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.783219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.783997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.784278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.784551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.785274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.786949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.797543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 963/1914] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:27.801712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.811804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33e41-678e-488a-a028-3573ab6d5e6b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.816764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.818617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.818978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.819718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] PATH_INFO: `/v3/projects/c059d18afc344fddab02bfa8da065a6b/users/54a97b9748b742be8a5b8fc89eb9bf61/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.833160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 952/1915] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:27.836673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c059d18afc344fddab02bfa8da065a6b, user_id=54a97b9748b742be8a5b8fc89eb9bf61, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.839531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.840436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.850705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e2d88-c765-454c-b659-2ae3efa003ec None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:27.855180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:27.855866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:27.856144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:27.856419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:27.857197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:27.859069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:27.922492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 964/1916] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:27 2022] PUT /identity/v3/projects/c059d18afc344fddab02bfa8da065a6b/users/54a97b9748b742be8a5b8fc89eb9bf61/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:27.926827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.984896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 953/1917] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:27.985669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:27.993275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d417c-62be-4ba7-8a90-f94c78faa044 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.057215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.057900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.058202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.058472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.059207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.060901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.061644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ae1cb-c60e-4e57-9e84-53f25e9f102e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.066917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.068633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.069091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.069599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.070549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.072518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.073945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 965/1918] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:28.078355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.088285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eba13-1cb5-450e-a7cb-85ef2d8d67c7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.093118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.094000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.094288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.094569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] PATH_INFO: `/v3/projects/c059d18afc344fddab02bfa8da065a6b/users/54a97b9748b742be8a5b8fc89eb9bf61/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.096557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c059d18afc344fddab02bfa8da065a6b, user_id=54a97b9748b742be8a5b8fc89eb9bf61, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.099244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242bef8-edf3-4372-a393-ed9f2b24e9c9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.109468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 966/1919] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:28 2022] PUT /identity/v3/projects/c059d18afc344fddab02bfa8da065a6b/users/54a97b9748b742be8a5b8fc89eb9bf61/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:28.120690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.129591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.129591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.150117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] MFA Rules not processed for user `54a97b9748b742be8a5b8fc89eb9bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:28.155030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:28.155164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 954/1920] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:27 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:28.156200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.167183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916dfe3-9a09-4884-9546-c9f8478d373e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.225559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 967/1921] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:28.237145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.238808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:28.247790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.248711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.249003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.249286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.250021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.251684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.262458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 955/1922] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:28.266509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.277775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc71f-12d6-4e53-96f7-b8ef4a4ccae6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.284636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.285688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.285971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.286787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] PATH_INFO: `/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499/users/f2adf0f52e644b3c9dacf8d0a9c944c3/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.314079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f253-3a34-4cb3-a912-5b17ab5c1dc6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.318109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.318521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65e2c57cbe34a5eb38e138e22bb8499, user_id=f2adf0f52e644b3c9dacf8d0a9c944c3, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.318764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.319052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.319335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.326403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.338820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.338820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.352655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 968/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:28.429896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 956/1924] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:28 2022] PUT /identity/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499/users/f2adf0f52e644b3c9dacf8d0a9c944c3/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:28.431392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.446836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf0ed-5fea-45f5-beca-d0ebd2a266b9 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.530411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.531669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.531669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.532081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.533143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.534648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52cbd3-7f73-4c3d-b7f0-23e51d129fb2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.553051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 969/1925] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:28.553254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:28.564453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b052c21-4cba-40a0-8367-46976016c24a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:28.569558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:28.570605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.570962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.571315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] PATH_INFO: `/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499/users/f2adf0f52e644b3c9dacf8d0a9c944c3/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.573617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65e2c57cbe34a5eb38e138e22bb8499, user_id=f2adf0f52e644b3c9dacf8d0a9c944c3, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:28.576432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:28.591148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 957/1926] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:28 2022] PUT /identity/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499/users/f2adf0f52e644b3c9dacf8d0a9c944c3/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:28.602754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:28.603292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:28.603292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:28.632792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] MFA Rules not processed for user `f2adf0f52e644b3c9dacf8d0a9c944c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:28.634004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:28.714956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 970/1927] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:29.007454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:29.085759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17659894-35cf-4941-ad84-6c377bd9bc33 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:29.089671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:29.090337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:29.090914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:29.091204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:29.104859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:29.108201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:29.121667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 958/1928] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:29.501116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:29.510799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210b5b8-23e0-4b6e-8d17-e4c5bcd6e107 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:29.514591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:29.517612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:29.517612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:29.517612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:29.586195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:29.587910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:29.596996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 971/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:29.829657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:29.835582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:29.842637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e5a08-1b00-45fc-bc83-1089b46d1679 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:29.846636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:29.847305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:29.848235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:29.848516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:29.850303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:29.907080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:29.908550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:29.920473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 959/1930] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:30.340817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:30.349720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50695d47-1fb0-4ccc-9d78-95b3537980cd service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:30.353591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:30.354233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:30.354519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:30.354794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:30.356603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:30.421760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:30.422829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:30.433570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 972/1931] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:32.825238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:32.827583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:32.893381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b825ae-5530-404e-9ced-d1928e8c3acd service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:32.898016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:32.898951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:32.899238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:32.899561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] PATH_INFO: `/v3/users/0a571e4eeb5446ee9cb606a0c4e83c7d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:32.900755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a571e4eeb5446ee9cb606a0c4e83c7d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:32.902698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:33.077769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a571e4eeb5446ee9cb606a0c4e83c7d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.078454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a571e4eeb5446ee9cb606a0c4e83c7d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.079088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a571e4eeb5446ee9cb606a0c4e83c7d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.121338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a571e4eeb5446ee9cb606a0c4e83c7d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.128334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c4f11655-f823-4949-94e9-96a6c922c267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a571e4eeb5446ee9cb606a0c4e83c7d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.144889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 960/1932] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:32 2022] DELETE /identity/v3/users/0a571e4eeb5446ee9cb606a0c4e83c7d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:33.379216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:33.389954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396e95-abed-4b52-b94f-d6610260f4d0 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:33.447013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:33.447899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.448183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.448459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] PATH_INFO: `/v3/projects/d5b8923fbdc54938aa80a75bc0d7d6d5` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.449659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b8923fbdc54938aa80a75bc0d7d6d5)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:33.451606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:33.548511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b8923fbdc54938aa80a75bc0d7d6d5', 'request_id': 'req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.618481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b8923fbdc54938aa80a75bc0d7d6d5', 'request_id': 'req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.624502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b8923fbdc54938aa80a75bc0d7d6d5', 'request_id': 'req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.634747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] The token cache is being invalidate because project d5b8923fbdc54938aa80a75bc0d7d6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:33.635039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.635689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e67bdb0c-6bf5-4c5d-b20b-36e8a41abbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:33.637199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 973/1933] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:33 2022] DELETE /identity/v3/projects/d5b8923fbdc54938aa80a75bc0d7d6d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:33.648322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.648612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.648891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.666416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:33.667678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:33.725844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 961/1934] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:33.733456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.733752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.734037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.752095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:33.753281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:33.761528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 974/1935] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:33.765588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:33.775585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252eb1c-31a8-4bc4-9f23-8ae6a4246b63 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:33.780224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:33.780862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.781149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.781424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.782136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:33.782442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:33.784176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:33.795178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 962/1936] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:33.799121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:33.808420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497ad8d-5fe5-4181-aac5-1880c9a39726 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:33.813411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:33.814043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.814325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.814601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.815279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:33.817249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:33.920421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 975/1937] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:33.923512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:33.934179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470d458-0374-4f44-a840-80cd8757e20b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:33.987370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:33.988077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:33.988390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:33.988670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:33.989877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:33.991852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.082336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 963/1938] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:33 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:34.087584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.099019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398501d-8d05-4176-bcaf-20ae69fb2b4c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.102277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.102990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.103283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.103667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.104465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.106151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.117204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 976/1939] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:34.121416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.132612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd1bc-6ed1-473b-b7ee-7fd3b5046236 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.137289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.138077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.138415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.138694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.139415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.141064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b9083-c9c7-429b-a2a9-e650a55bbeca admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.151533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 964/1940] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:34.155748 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.165489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfe86-81be-4496-8c92-b21c22a9ae32 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.170281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.171154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.171388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.171699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] PATH_INFO: `/v3/projects/d767aab5df39449a922546bbbaf537af/users/cfe6d82ffd9042e5ba1e1545442855d3/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.186978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d767aab5df39449a922546bbbaf537af, user_id=cfe6d82ffd9042e5ba1e1545442855d3, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.189659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.259307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 977/1941] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:34 2022] PUT /identity/v3/projects/d767aab5df39449a922546bbbaf537af/users/cfe6d82ffd9042e5ba1e1545442855d3/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:34.269343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.269642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.269928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.295911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] MFA Rules not processed for user `cfe6d82ffd9042e5ba1e1545442855d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:34.297145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:34.359519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 965/1942] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:34.363937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.422833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e6d4-268f-46e2-8d4b-b8fc51a3ea05 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.428263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.428914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.429203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.429484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.430184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.432155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.510949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 978/1943] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:34 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:34.514672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.525143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae246db7-2028-41d5-8467-ce5cb31f6ca8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.579536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.580201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.580490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.580769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.581451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.583444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.686376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 966/1944] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:34 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:34.690254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.700616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0314e75-5c1c-439d-b331-ef5c04aca91c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.705240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.705895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.706184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.706463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.707183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.709387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.719977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 979/1945] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:34.724675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.734524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ccc9a-62bd-485d-b3e4-91f34672d564 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.739249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.740163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.740444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.740718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] PATH_INFO: `/v3/projects/1f02139ff4554e9cafe591f676e2cecf/users/b79cf791fc7b4ad0a19c1836567a77c6/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.754881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f02139ff4554e9cafe591f676e2cecf, user_id=b79cf791fc7b4ad0a19c1836567a77c6, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.757598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.806302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 967/1946] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:34 2022] PUT /identity/v3/projects/1f02139ff4554e9cafe591f676e2cecf/users/b79cf791fc7b4ad0a19c1836567a77c6/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:34.810187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.820040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c7058-7480-4409-b3ed-53b297ccecc3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.875060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.875753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.876037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.876315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.877026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.878626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1bae4-1b00-48e4-92b9-cdc11dc77779 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.888197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 980/1947] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:34.892424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:34.902947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf5480-1dcd-4e11-8dc8-076a70e0ed3b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:34.907631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:34.908507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.908794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.909074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] PATH_INFO: `/v3/projects/1f02139ff4554e9cafe591f676e2cecf/users/b79cf791fc7b4ad0a19c1836567a77c6/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.911085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f02139ff4554e9cafe591f676e2cecf, user_id=b79cf791fc7b4ad0a19c1836567a77c6, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:34.914363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:34.925079 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 968/1948] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:34 2022] PUT /identity/v3/projects/1f02139ff4554e9cafe591f676e2cecf/users/b79cf791fc7b4ad0a19c1836567a77c6/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:34.935955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:34.936252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:34.936590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:34.962791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] MFA Rules not processed for user `b79cf791fc7b4ad0a19c1836567a77c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:34.964056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:35.029915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 981/1949] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:35.040884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:35.042541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:35.097473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94ee0-e8ed-4c09-be62-b86eff4631d7 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:35.101262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:35.101899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:35.102184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:35.102464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:35.111860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:35.113298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f9a15-3166-4fc5-8b58-44595030632b service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:35.122730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 969/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:35.938304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:36.009336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa4dd8-6533-4cae-8f8d-bf6538e87e4c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:36.015168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:36.016094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:36.016388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:36.016893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] PATH_INFO: `/v3/users/cfe6d82ffd9042e5ba1e1545442855d3` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:36.018010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe6d82ffd9042e5ba1e1545442855d3)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:36.019987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:36.214567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe6d82ffd9042e5ba1e1545442855d3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:36.215241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe6d82ffd9042e5ba1e1545442855d3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:36.215871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe6d82ffd9042e5ba1e1545442855d3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:36.298451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe6d82ffd9042e5ba1e1545442855d3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:36.312832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe6d82ffd9042e5ba1e1545442855d3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:36.326710 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 982/1951] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:35 2022] DELETE /identity/v3/users/cfe6d82ffd9042e5ba1e1545442855d3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:36.331315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:36.331817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:36.331925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:36.350982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:36.352210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:36.408980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 970/1952] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:36.419425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:36.421142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:36.508277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3790bb-2312-4f1e-99c1-90a76280d5fe admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:36.528938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:36.530424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:36.530784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:36.531135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:36.545878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:36.547939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c098b2-1736-4210-84c0-efa296f87740 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:36.563697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 983/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:36.958666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:36.960198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:36.973608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9e323-45b7-4835-ba97-87951769bf01 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:36.980081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:36.983006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:36.983006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:36.983006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] PATH_INFO: `/v3/projects/d767aab5df39449a922546bbbaf537af` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:36.983006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d767aab5df39449a922546bbbaf537af)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:36.984974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:37.111417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd767aab5df39449a922546bbbaf537af', 'request_id': 'req-45e210b8-2660-4783-aa29-ddbe0761c3b9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.140832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:37.141372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:37.141477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:37.158901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] MFA Rules not processed for user `69b4c5f51c5943ef95fd751c67d2e901`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:37.161845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:37.189649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd767aab5df39449a922546bbbaf537af', 'request_id': 'req-45e210b8-2660-4783-aa29-ddbe0761c3b9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.196710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd767aab5df39449a922546bbbaf537af', 'request_id': 'req-45e210b8-2660-4783-aa29-ddbe0761c3b9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.208703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] The token cache is being invalidate because project d767aab5df39449a922546bbbaf537af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:37.208991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.209679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.211722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 971/1954] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:36 2022] DELETE /identity/v3/projects/d767aab5df39449a922546bbbaf537af => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:37.215532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:37.216888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 984/1955] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:37.217020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:37.284528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e210b8-2660-4783-aa29-ddbe0761c3b9 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:37.289821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:37.290698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:37.290984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:37.291264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] PATH_INFO: `/v3/users/b79cf791fc7b4ad0a19c1836567a77c6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:37.292582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79cf791fc7b4ad0a19c1836567a77c6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:37.294538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:37.495638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79cf791fc7b4ad0a19c1836567a77c6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.496465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79cf791fc7b4ad0a19c1836567a77c6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.496970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79cf791fc7b4ad0a19c1836567a77c6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.672021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79cf791fc7b4ad0a19c1836567a77c6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.672021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79cf791fc7b4ad0a19c1836567a77c6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:37.680040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 972/1956] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:37 2022] DELETE /identity/v3/users/b79cf791fc7b4ad0a19c1836567a77c6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:38.195064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:38.206086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5278fc-c65c-4473-98d2-30936afe5846 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:38.265586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:38.266436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.266727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.267003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] PATH_INFO: `/v3/projects/1f02139ff4554e9cafe591f676e2cecf` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.268244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f02139ff4554e9cafe591f676e2cecf)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:38.270128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:38.392478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:38.394180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:38.397215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f02139ff4554e9cafe591f676e2cecf', 'request_id': 'req-7b7357f6-bfb2-47dd-a202-7221f4a95818'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:38.450355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe934-8f1c-4d01-a0e1-3918d0d22dc3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:38.476752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f02139ff4554e9cafe591f676e2cecf', 'request_id': 'req-7b7357f6-bfb2-47dd-a202-7221f4a95818'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:38.484050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f02139ff4554e9cafe591f676e2cecf', 'request_id': 'req-7b7357f6-bfb2-47dd-a202-7221f4a95818'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:38.495981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] The token cache is being invalidate because project 1f02139ff4554e9cafe591f676e2cecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:38.496282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:38.496953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7b7357f6-bfb2-47dd-a202-7221f4a95818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:38.498863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 985/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:38 2022] DELETE /identity/v3/projects/1f02139ff4554e9cafe591f676e2cecf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:38.501623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:38.502566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.502852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.503132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.503338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.503654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.505284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:38.505488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.524599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:38.525799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:38.568243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:38.569762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28250-d435-4726-880f-72df8ced5f5c service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:38.579785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 973/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:38.585277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 986/1959] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:38.593060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.593397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.593896 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.612528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:38.613713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:38.621918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 974/1960] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:38.626597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:38.636604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56df5f-487c-4b1a-b26d-f42d9fe5df83 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:38.642677 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:38.643337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.644475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.644817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.646689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:38.647012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:38.648906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:38.662768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 987/1961] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:38.667082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:38.678019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63852-77ab-4cd5-8162-7475b0be8b1a None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:38.682930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:38.683620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.683904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.684440 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.685210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:38.687184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:38.805095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 975/1962] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:38 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:38.806400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:38.816566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ac8ab-2abb-44ae-bf2e-8ae612c738d3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:38.874345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:38.875027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:38.875369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:38.875744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:38.876398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:38.878357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:38.996555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 988/1963] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:38 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:39.000491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.012712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0981e-7837-485f-a0d1-be0d6fd9b316 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.017469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.019703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.019703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.019703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.019703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.021751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.032959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 976/1964] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:39.044975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.059950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea89282-192f-46f1-bbab-261635f667db admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.064763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.065596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.066029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.066414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.067922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.069780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24182f-cd41-4226-bb1f-a3b1b99c4d36 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.080619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 989/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:39.085350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.095103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56c89f-55c1-4382-8c57-48d507ebe79d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.099782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.100745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.101028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.101303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] PATH_INFO: `/v3/projects/df0ac7e80c3f46749148c610f25be4d8/users/ed0901d69f9141d7bb5139caff5df935/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.116435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0ac7e80c3f46749148c610f25be4d8, user_id=ed0901d69f9141d7bb5139caff5df935, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.119089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.247513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 977/1966] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:39 2022] PUT /identity/v3/projects/df0ac7e80c3f46749148c610f25be4d8/users/ed0901d69f9141d7bb5139caff5df935/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:39.258335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.258847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.258934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.286110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] MFA Rules not processed for user `ed0901d69f9141d7bb5139caff5df935`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:39.287431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:39.350808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 990/1967] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:39.355324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.415927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ecfc8-e368-476f-93aa-3c7cf2a65649 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.420670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.421330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.421616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.421892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.422592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.424557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.523715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 978/1968] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:39 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:39.527703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.539015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca6bc2-a42a-42cf-9fec-41d45a18b0b5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.594645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.595311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.595774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.597011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.597011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.599080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.637556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.637657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:39.650902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c17596-94fb-4f1f-ba90-75596b88b91f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.656196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.660357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.660357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.660357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] PATH_INFO: `/v3/users/51bd7aa59b0e4fbba9362d6aa6c587ba` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.660357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bd7aa59b0e4fbba9362d6aa6c587ba)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.660722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.685177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 991/1969] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:39 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:39.685177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.685177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:39.696642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214496f1-e1d4-47cf-b5e7-32feb4165433 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:39.701438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:39.702290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:39.705428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:39.705428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] PATH_INFO: `/v3/users/195312b0498d4622ae67f79463e184cd` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:39.705428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195312b0498d4622ae67f79463e184cd)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:39.706071 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:39.802811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bd7aa59b0e4fbba9362d6aa6c587ba'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.803549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bd7aa59b0e4fbba9362d6aa6c587ba'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.804176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bd7aa59b0e4fbba9362d6aa6c587ba'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.836511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195312b0498d4622ae67f79463e184cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.837172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195312b0498d4622ae67f79463e184cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.837792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195312b0498d4622ae67f79463e184cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.903232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bd7aa59b0e4fbba9362d6aa6c587ba'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.910576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bd7aa59b0e4fbba9362d6aa6c587ba'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.928839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 979/1970] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:39 2022] DELETE /identity/v3/users/51bd7aa59b0e4fbba9362d6aa6c587ba => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:39.929656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:39.932457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:39.991003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195312b0498d4622ae67f79463e184cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:39.999069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f84b21-cd8f-4aa7-9455-0fa4b6690d4c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.004206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.004886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.005172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.005449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.006190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.006424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195312b0498d4622ae67f79463e184cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:40.007887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e7418-75bb-43f0-82e4-677a1a1251c6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.022135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 980/1971] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:40.022135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a8a-b99c-46e6-9900-36b0a45d3576 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.022135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a8a-b99c-46e6-9900-36b0a45d3576 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.022135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6a8a-b99c-46e6-9900-36b0a45d3576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.025102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 992/1972] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:39 2022] DELETE /identity/v3/users/195312b0498d4622ae67f79463e184cd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:40.027678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.032134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.056705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-07ec6a8a-b99c-46e6-9900-36b0a45d3576 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:40.056705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-07ec6a8a-b99c-46e6-9900-36b0a45d3576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.128786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b45a-9b86-4c21-99fa-5b8f97e69771 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.136441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.137730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.138193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.138620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] PATH_INFO: `/v3/projects/e0eea60572fd4695b752d619b25f51ea/users/98779b654bfd4fb497077f9885f74d0d/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.148219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 981/1973] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:40.149812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.150107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.150392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.171301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0eea60572fd4695b752d619b25f51ea, user_id=98779b654bfd4fb497077f9885f74d0d, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.171301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.171519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:40.172762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.181719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 982/1974] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:40.182705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.184002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.252484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 993/1975] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:40 2022] PUT /identity/v3/projects/e0eea60572fd4695b752d619b25f51ea/users/98779b654bfd4fb497077f9885f74d0d/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:40.253570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.258604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.277639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145328e-16a3-47ba-bbfc-52d0fbe3d786 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.328593 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70cb00-1301-4afd-a439-7d07b3b1beb4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.332791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.334156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.334712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.335426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.342652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.344371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.344371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.344371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.415002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.417118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.419924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.421482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.428556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 994/1976] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:40.431903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.441251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6ddbd-4548-4f21-9ec5-1867c3e650ec service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.446886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.447694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.447984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.448274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.449137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.450809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 983/1977] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:40.451243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ccb60-d4ed-4307-9cb9-9381619acc09 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.471509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 995/1978] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:40.475723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.487947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d2c4b-e010-47e4-a34f-b7f02846ac17 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.494387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.495448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.495911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.496268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] PATH_INFO: `/v3/projects/e0eea60572fd4695b752d619b25f51ea/users/98779b654bfd4fb497077f9885f74d0d/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.500236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0eea60572fd4695b752d619b25f51ea, user_id=98779b654bfd4fb497077f9885f74d0d, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.501402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.513051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 984/1979] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:40 2022] PUT /identity/v3/projects/e0eea60572fd4695b752d619b25f51ea/users/98779b654bfd4fb497077f9885f74d0d/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:40.524892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.525310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.525633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.555877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] MFA Rules not processed for user `98779b654bfd4fb497077f9885f74d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:40.557159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.632878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 996/1980] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:40.644472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.646742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.712338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa19f-6b44-4c68-813c-9edebd82d7dd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.717005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.717770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.718047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.718385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.731495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.734366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:40.747459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 985/1981] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:40.901822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:40.904012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:40.976898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1414bd-ce30-45a2-aeee-b2625d5a31d1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:40.981540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:40.982583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:40.982866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:40.983143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] PATH_INFO: `/v3/projects/4ea7944b5886442db6240d961a37fa6b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:40.984458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea7944b5886442db6240d961a37fa6b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:40.986376 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:41.004083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:41.006345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:41.039835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36773f5-19b0-4a30-8dae-608de0883c98 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:41.043143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:41.044101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:41.044389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:41.044698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] PATH_INFO: `/v3/projects/07dc5a4ff8474eeb8859a7f746bd362f` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:41.045964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dc5a4ff8474eeb8859a7f746bd362f)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:41.047938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:41.166582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dc5a4ff8474eeb8859a7f746bd362f', 'request_id': 'req-331e216d-499e-42e2-956e-9cb76ec15910'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.167005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea7944b5886442db6240d961a37fa6b', 'request_id': 'req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.247325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea7944b5886442db6240d961a37fa6b', 'request_id': 'req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.259496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea7944b5886442db6240d961a37fa6b', 'request_id': 'req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.274895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] The token cache is being invalidate because project 4ea7944b5886442db6240d961a37fa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:41.275204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.275960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.277768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 997/1982] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:40 2022] DELETE /identity/v3/projects/4ea7944b5886442db6240d961a37fa6b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:41.278544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:41.280154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:41.333050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dc5a4ff8474eeb8859a7f746bd362f', 'request_id': 'req-331e216d-499e-42e2-956e-9cb76ec15910'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.339970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dc5a4ff8474eeb8859a7f746bd362f', 'request_id': 'req-331e216d-499e-42e2-956e-9cb76ec15910'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.358972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] The token cache is being invalidate because project 07dc5a4ff8474eeb8859a7f746bd362f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:41.359340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.360536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0ce12-9a9f-4f3e-aec2-0de3cd34ee87 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:41.362540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.364961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 986/1983] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:41 2022] DELETE /identity/v3/projects/07dc5a4ff8474eeb8859a7f746bd362f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:41.368542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:41.374194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:41.469977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e216d-499e-42e2-956e-9cb76ec15910 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:41.470340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:41.471328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:41.471802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:41.472092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:41.474693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:41.481209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:41.483254 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:41.483789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:41.484189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] PATH_INFO: `/v3/users/6ed740b976f2416bada65c7e90710382` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:41.485966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed740b976f2416bada65c7e90710382)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:41.488059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:41.575630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:41.577007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:41.586669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 998/1984] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:41.588476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:41.590227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:41.608868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3619e7-87e5-4a7a-a631-aa152b7edf20 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:41.614929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:41.616023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:41.616321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:41.616603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] PATH_INFO: `/v3/users/f2adf0f52e644b3c9dacf8d0a9c944c3` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:41.622961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2adf0f52e644b3c9dacf8d0a9c944c3)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:41.625168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:41.643490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed740b976f2416bada65c7e90710382'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.644911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed740b976f2416bada65c7e90710382'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.646689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed740b976f2416bada65c7e90710382'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.725992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed740b976f2416bada65c7e90710382'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.733718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed740b976f2416bada65c7e90710382'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.751389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 987/1985] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:41 2022] DELETE /identity/v3/users/6ed740b976f2416bada65c7e90710382 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:41.790437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2adf0f52e644b3c9dacf8d0a9c944c3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.791108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2adf0f52e644b3c9dacf8d0a9c944c3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.791761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2adf0f52e644b3c9dacf8d0a9c944c3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.863117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2adf0f52e644b3c9dacf8d0a9c944c3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.877449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2adf0f52e644b3c9dacf8d0a9c944c3'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:41.890441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 999/1986] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:41 2022] DELETE /identity/v3/users/f2adf0f52e644b3c9dacf8d0a9c944c3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:42.261518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.265530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.337519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28eda08-b80b-4217-9f94-75225357f284 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.405718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.407060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.407269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.408205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.408510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.408854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] PATH_INFO: `/v3/projects/8341583a02cd4ae5a17985466c66040f` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.410533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8341583a02cd4ae5a17985466c66040f)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.412692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.421647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e879e-cb82-440c-be6d-949657061fe3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.428454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.429303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.429587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.429867 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] PATH_INFO: `/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.431054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65e2c57cbe34a5eb38e138e22bb8499)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.432989 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.571855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65e2c57cbe34a5eb38e138e22bb8499', 'request_id': 'req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.576030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8341583a02cd4ae5a17985466c66040f', 'request_id': 'req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.653137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8341583a02cd4ae5a17985466c66040f', 'request_id': 'req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.660586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8341583a02cd4ae5a17985466c66040f', 'request_id': 'req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.673426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] The token cache is being invalidate because project 8341583a02cd4ae5a17985466c66040f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:42.673720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.674422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bd642eb5-7059-4cb7-a181-dbb74d3fc68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.676638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 988/1987] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:42 2022] DELETE /identity/v3/projects/8341583a02cd4ae5a17985466c66040f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:42.682685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df384-d552-474d-8642-bf40477d3ac7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.682972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df384-d552-474d-8642-bf40477d3ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.683251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df384-d552-474d-8642-bf40477d3ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.701088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c59df384-d552-474d-8642-bf40477d3ac7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:42.702460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c59df384-d552-474d-8642-bf40477d3ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.755981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65e2c57cbe34a5eb38e138e22bb8499', 'request_id': 'req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.762595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65e2c57cbe34a5eb38e138e22bb8499', 'request_id': 'req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.764708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 989/1988] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:42.772640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.772936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.773223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.780515 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] The token cache is being invalidate because project b65e2c57cbe34a5eb38e138e22bb8499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:42.780809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.782739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-35fbae2b-43a5-4ac3-9cc1-352d58dbd92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:42.783007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1000/1989] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:42 2022] DELETE /identity/v3/projects/b65e2c57cbe34a5eb38e138e22bb8499 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:42.788442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30d18-7b98-4669-bde0-ffbd6c07ed3d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.788671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30d18-7b98-4669-bde0-ffbd6c07ed3d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.789130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30d18-7b98-4669-bde0-ffbd6c07ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.797204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:42.798415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.807494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 990/1990] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:42.812917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-15b30d18-7b98-4669-bde0-ffbd6c07ed3d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:42.812917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-15b30d18-7b98-4669-bde0-ffbd6c07ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.814067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.821077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1001/1991] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:42.825805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff4aeb-0578-48e2-b639-dd7d6bedbe12 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.828733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.829159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.829476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.831269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.831976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.832263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.832542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.833404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:42.833726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.835432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.852114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 991/1992] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:42.853166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.853292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:42.855021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:42.865779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640572-9c3c-4462-b66d-2a0531f14cef admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.869940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1002/1993] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:42.871294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.878551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.879615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.880140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.880653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.881320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca6a7-056f-4294-8def-6a3e38790bbf None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.881960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.885129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.886428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.887231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.887555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.887952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.889100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:42.889411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.891381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.907095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1003/1994] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:42.911941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.922438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39a80-424f-4f6d-bcc1-9baacec2b28c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:42.927504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:42.928156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:42.928444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:42.928745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:42.929457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:42.931340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:42.975148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 992/1995] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:42.975649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:42.977197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.042009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1004/1996] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:42 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:43.042009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.045067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5481-9114-4cd7-90dc-5bd286f5b8a8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.105476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23864cef-52d1-4d09-bd65-0646dc468883 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.109714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.110611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.110892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.111012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.111175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] PATH_INFO: `/v3/users/a100af15eaa646808b3d175c11d6d76e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.111691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.111987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.112401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.113100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a100af15eaa646808b3d175c11d6d76e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.113222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.115440 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.119618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.187076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1005/1997] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:43.187076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.194406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27471b53-2dad-4ee5-98d5-600d78c188a1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.199571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.200379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.200728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.201014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.201827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.204003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.282482 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1006/1998] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/users => generated 280 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:43.283302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.293727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a100af15eaa646808b3d175c11d6d76e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:43.294610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a100af15eaa646808b3d175c11d6d76e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:43.295292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a100af15eaa646808b3d175c11d6d76e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:43.297858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080ced-e889-4f55-9b0e-8733a16e5c12 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.303781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.304447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.304732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.305010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.305728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.307544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.318304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1007/1999] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:43.319187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.322120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.336375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027460f4-5e0d-402e-a40f-024dbd7e7937 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.341565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.342232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.342660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.342971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.343799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.345535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.349901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a100af15eaa646808b3d175c11d6d76e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:43.360725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1008/2000] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:43.360817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a100af15eaa646808b3d175c11d6d76e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:43.360909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.361642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.374343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040869c-28d2-4d4d-8f50-cb7c3e7b4f49 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.380770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 993/2001] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:42 2022] DELETE /identity/v3/users/a100af15eaa646808b3d175c11d6d76e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:43.380770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.451931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557714b-c114-4209-9b01-ba54476a29d8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.452780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.454260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.454866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.455353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.456430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.456781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.457447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.457732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.458643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.459372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.460221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645234c-7fd4-4367-9d0b-2ab0b51afde8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.461007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.474475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 994/2002] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:43.474696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1009/2003] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:43.474696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.474696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.474696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.476445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.486464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1feef-3b4f-4181-a2c1-8809cc20a9c2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.494804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.495756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.496060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.496306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] PATH_INFO: `/v3/projects/5d65134a93ca4b0cb12c48024c8d95a6/users/15ee01e7e02449f587ae124993788b9c/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.500654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:43.501869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.515463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d65134a93ca4b0cb12c48024c8d95a6, user_id=15ee01e7e02449f587ae124993788b9c, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.518134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1010/2004] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:43.518974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.519817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.530313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4113d-1a77-4039-a0f1-451e31024268 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.536686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.537572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.538402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.538402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] PATH_INFO: `/v3/projects/b73abe0806df487fbf320be296abfd90/users/43c56fc1a41f44eaaf7e484ab4174ba8/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.557080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73abe0806df487fbf320be296abfd90, user_id=43c56fc1a41f44eaaf7e484ab4174ba8, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.560778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ead5-3d4d-40c8-8fb5-fe2ad2c90c25 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.592579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 995/2005] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:43 2022] PUT /identity/v3/projects/5d65134a93ca4b0cb12c48024c8d95a6/users/15ee01e7e02449f587ae124993788b9c/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:43.593417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.595264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.636952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1011/2006] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:43 2022] PUT /identity/v3/projects/b73abe0806df487fbf320be296abfd90/users/43c56fc1a41f44eaaf7e484ab4174ba8/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:43.652772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afb8c-3523-4dc6-9a96-fca1ec6f04bc None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.654563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afb8c-3523-4dc6-9a96-fca1ec6f04bc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.654563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afb8c-3523-4dc6-9a96-fca1ec6f04bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.685129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cad78-ef9f-4e5a-8563-5b5b0d1f748d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.687487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-4c4afb8c-3523-4dc6-9a96-fca1ec6f04bc None None] MFA Rules not processed for user `15ee01e7e02449f587ae124993788b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:43.688853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4c4afb8c-3523-4dc6-9a96-fca1ec6f04bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.742980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.743680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.744016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.744304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.769537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1012/2007] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:43.769537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.769537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.769537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.806222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] MFA Rules not processed for user `43c56fc1a41f44eaaf7e484ab4174ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:43.807443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.856134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.857626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.867863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 996/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:43.868688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.870048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:43.884192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1013/2009] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:43.888670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.899253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4732c-b720-46b8-a8c9-bbbd5580961e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.912929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.912929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.912929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.912929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.913303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.913303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.935341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb8546-431c-4dde-9085-b98426b118f6 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.939606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:43.940253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:43.940541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:43.940847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:43.950488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:43.951981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:43.961488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 997/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:43.975140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:43.986370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347186-aa5d-4c55-9862-cc76b86666f5 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:43.995961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.005560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.005560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.005560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] PATH_INFO: `/v3/users/15ee01e7e02449f587ae124993788b9c` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.005560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ee01e7e02449f587ae124993788b9c)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.005560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.031637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1014/2011] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:44.037369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.096501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2109e-f535-4ab3-bff7-c4d317d0fee6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.101853 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.102518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.102806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.103174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.103906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.105838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.225375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1015/2012] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:44 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:44.230370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.234319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ee01e7e02449f587ae124993788b9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.235146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ee01e7e02449f587ae124993788b9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.235770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ee01e7e02449f587ae124993788b9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.241755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864b6b9-1d6e-4eb2-aaed-065cfe38d2de admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.247450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.252491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.252491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.252491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.252491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.252491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.261289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1016/2013] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:44.265394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.267121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.279263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca049-897f-48c4-a8e4-899e662f43dd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.284035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.284887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.285255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.285536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] PATH_INFO: `/v3/projects/df77fca2274943ae9233b090ab4a59c9/users/ee5c3d31bc604bcf98b8e1af01ba5e4a/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.300312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df77fca2274943ae9233b090ab4a59c9, user_id=ee5c3d31bc604bcf98b8e1af01ba5e4a, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.303659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.326603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ee01e7e02449f587ae124993788b9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.334097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dd27aba2-661d-47c7-b353-17da98fb2eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ee01e7e02449f587ae124993788b9c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.353398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 998/2014] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:43 2022] DELETE /identity/v3/users/15ee01e7e02449f587ae124993788b9c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:44.355817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.356108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.356388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.373308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:44.374489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.411831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1017/2015] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:44 2022] PUT /identity/v3/projects/df77fca2274943ae9233b090ab4a59c9/users/ee5c3d31bc604bcf98b8e1af01ba5e4a/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:44.411831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.413788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.436818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 999/2016] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:44.443929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.449994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192caded-24f6-4a11-b5f2-080f6c3f27fd None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.477458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6cd69-6a97-4b73-acb4-df64f5ed4b85 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.482218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.483070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.483361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.483681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] PATH_INFO: `/v3/projects/729058e754f0485ea182611f4390bd1a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.485059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] RBAC: Authorizing `identity:delete_project(project_id=729058e754f0485ea182611f4390bd1a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.487314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.505123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.505783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.506064 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.506339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.507055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.508707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.518125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1000/2017] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:44.518912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.521068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.574860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf782-9ff5-42bb-a394-6ed5ca973e13 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.578580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.579220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.579544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.579827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.589524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.590994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.600841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1001/2018] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:44.601574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.610537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65494-e474-43b1-a75d-d431434ebd45 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.626317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729058e754f0485ea182611f4390bd1a', 'request_id': 'req-dde8ade0-1674-4cb5-9b4b-ce37893d827f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.670880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.671806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.672093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.672371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] PATH_INFO: `/v3/projects/df77fca2274943ae9233b090ab4a59c9/users/ee5c3d31bc604bcf98b8e1af01ba5e4a/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.674413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df77fca2274943ae9233b090ab4a59c9, user_id=ee5c3d31bc604bcf98b8e1af01ba5e4a, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.677434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2d190-84af-4488-8468-8c51d11f594c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.687519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1002/2019] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:44 2022] PUT /identity/v3/projects/df77fca2274943ae9233b090ab4a59c9/users/ee5c3d31bc604bcf98b8e1af01ba5e4a/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:44.697286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.697580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.697879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.703305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729058e754f0485ea182611f4390bd1a', 'request_id': 'req-dde8ade0-1674-4cb5-9b4b-ce37893d827f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.710568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729058e754f0485ea182611f4390bd1a', 'request_id': 'req-dde8ade0-1674-4cb5-9b4b-ce37893d827f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.720852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] The token cache is being invalidate because project 729058e754f0485ea182611f4390bd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:44.721144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.721823 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:44.723429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1018/2020] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:44 2022] DELETE /identity/v3/projects/729058e754f0485ea182611f4390bd1a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:44.725751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] MFA Rules not processed for user `ee5c3d31bc604bcf98b8e1af01ba5e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:44.727010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.727728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.729027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.741742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ade0-1674-4cb5-9b4b-ce37893d827f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.795817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1003/2021] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:44.800611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.801512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.801804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.802100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] PATH_INFO: `/v3/users/21cc0338d57f4a7d959f40a58b9d7e48` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.803323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cc0338d57f4a7d959f40a58b9d7e48)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.805399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.808206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:44.809577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.874140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8466-ace6-4fa9-8886-f9889819c97e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:44.874140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:44.874140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:44.874140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:44.874713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:44.876549 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:44.945789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:44.947405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:44.957555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1004/2022] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:45.021468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cc0338d57f4a7d959f40a58b9d7e48'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.022174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cc0338d57f4a7d959f40a58b9d7e48'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.022768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cc0338d57f4a7d959f40a58b9d7e48'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.084500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.084833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.099664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd91b4-f567-48f7-ba86-a3007239c87a service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.104292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cc0338d57f4a7d959f40a58b9d7e48'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.106080 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.107318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.107653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.107987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] PATH_INFO: `/v3/projects/5d65134a93ca4b0cb12c48024c8d95a6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.109612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d65134a93ca4b0cb12c48024c8d95a6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.111945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.125375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cc0338d57f4a7d959f40a58b9d7e48'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.141408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1019/2023] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:44 2022] DELETE /identity/v3/users/21cc0338d57f4a7d959f40a58b9d7e48 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:45.183417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.185154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.264992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d65134a93ca4b0cb12c48024c8d95a6', 'request_id': 'req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.266888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365cd6e-9342-44bb-863d-1ff35d1a3793 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.320540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.321437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.321725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.322005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] PATH_INFO: `/v3/users/ed0901d69f9141d7bb5139caff5df935` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.323205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0901d69f9141d7bb5139caff5df935)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.325170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.367129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d65134a93ca4b0cb12c48024c8d95a6', 'request_id': 'req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.373914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d65134a93ca4b0cb12c48024c8d95a6', 'request_id': 'req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.388109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] The token cache is being invalidate because project 5d65134a93ca4b0cb12c48024c8d95a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:45.388399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.389757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b64df4cb-1e3b-45f0-8dfe-1057d0bd9743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.391988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1005/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:45 2022] DELETE /identity/v3/projects/5d65134a93ca4b0cb12c48024c8d95a6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:45.397599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6778-1515-456b-9225-8122de85ab33 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.397892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6778-1515-456b-9225-8122de85ab33 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.398180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d6778-1515-456b-9225-8122de85ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.419350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8c1d6778-1515-456b-9225-8122de85ab33 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:45.420609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8c1d6778-1515-456b-9225-8122de85ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.428897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1006/2025] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:45.437483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.437776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.438055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.455787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:45.456983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.470283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1007/2026] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:45.476129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.485534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd9b8-bcf2-4967-9e1c-0f8a3164f357 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.490483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.491266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.491584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.491923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.498076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:45.498076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.498076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.502737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0901d69f9141d7bb5139caff5df935'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.503587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0901d69f9141d7bb5139caff5df935'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.504291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0901d69f9141d7bb5139caff5df935'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.509978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1008/2027] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:45.511081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.512737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.525266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaac9f8-8c3e-483b-8988-931631f296c8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.529803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.530429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.530714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.531025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.531730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.533612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518651-7b82-4871-ae2e-7cfe7bb220f1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.554372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0901d69f9141d7bb5139caff5df935'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.568060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0901d69f9141d7bb5139caff5df935'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.589911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1020/2028] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:45 2022] DELETE /identity/v3/users/ed0901d69f9141d7bb5139caff5df935 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:45.589911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.589911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.615587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1009/2029] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:45 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:45.615823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.618583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.618583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.634236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:45.635377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.654882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5df49b-6944-4f70-b388-2e3669c15f44 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.698889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1010/2030] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:45.699754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.711797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa785bb-2601-42b9-b15a-47d1577452ab None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.718179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.718841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.719129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.719408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.720142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.721235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.722246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.722973 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.723265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.723616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] PATH_INFO: `/v3/projects/f547cdb52e684ba8b2c16c310e7527dc` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.725112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f547cdb52e684ba8b2c16c310e7527dc)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.727255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.815239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1011/2031] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:45 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:45.815239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.815239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.847408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f547cdb52e684ba8b2c16c310e7527dc', 'request_id': 'req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.872618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fbfc4-e205-4af0-b795-13047d0cb357 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:45.919154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:45.919771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:45.920060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:45.920391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:45.920964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f547cdb52e684ba8b2c16c310e7527dc', 'request_id': 'req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.928328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f547cdb52e684ba8b2c16c310e7527dc', 'request_id': 'req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.938890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] The token cache is being invalidate because project f547cdb52e684ba8b2c16c310e7527dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:45.939180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.939885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:45.947442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1021/2032] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:45 2022] DELETE /identity/v3/projects/f547cdb52e684ba8b2c16c310e7527dc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:45.948272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:45.951307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:45.983200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:45.984683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:45.995052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1012/2033] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:45.995973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.005085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54964b84-f519-4d82-a797-ea4087bfcc52 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.010252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.011114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.011875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.011991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] PATH_INFO: `/v3/users/54a97b9748b742be8a5b8fc89eb9bf61` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.013183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a97b9748b742be8a5b8fc89eb9bf61)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.015095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.015414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15b24-b1f5-48d3-8946-c65ae1be3e7e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.020511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.021502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.021612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.022028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.022762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.025458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.041278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1022/2034] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:46.042380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.053096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a26f7-c880-4ccd-9a9d-174d1e72b8ee admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.057952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.058630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.058900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.059178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.059945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.061581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.072937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1023/2035] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:46.077213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.088331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a473-0774-4ba6-8f92-5bac1651f08e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.092885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.095878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.095878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.095878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] PATH_INFO: `/v3/projects/fb72b8a8163341ddbb4d2e26e7bdf79e/users/51d34a1466f54010a4f4b10f10894996/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.111876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb72b8a8163341ddbb4d2e26e7bdf79e, user_id=51d34a1466f54010a4f4b10f10894996, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.115293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ad1d1-918d-4f64-a61f-5523dc961f2d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.184314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a97b9748b742be8a5b8fc89eb9bf61'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.185047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a97b9748b742be8a5b8fc89eb9bf61'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.205150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a97b9748b742be8a5b8fc89eb9bf61'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.229634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1024/2036] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:46 2022] PUT /identity/v3/projects/fb72b8a8163341ddbb4d2e26e7bdf79e/users/51d34a1466f54010a4f4b10f10894996/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:46.245110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.245414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.245683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.280353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] MFA Rules not processed for user `51d34a1466f54010a4f4b10f10894996`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:46.280353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:46.353181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1025/2037] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:46.365013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.366572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:46.420921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606ac0b-f70b-417f-8688-fe490f4af860 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.425010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.425650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.425964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.426243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.435188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.436613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.445509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1026/2038] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:46.498425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a97b9748b742be8a5b8fc89eb9bf61'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.506057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a97b9748b742be8a5b8fc89eb9bf61'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.523768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1013/2039] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:45 2022] DELETE /identity/v3/users/54a97b9748b742be8a5b8fc89eb9bf61 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:46.539909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.541380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:46.630679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef857c-e77d-4747-af0c-fb8d1eb795ea service glance] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:46.711614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:46.712661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:46.713054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:46.713578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] PATH_INFO: `/v3/projects/df0ac7e80c3f46749148c610f25be4d8` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:46.714966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0ac7e80c3f46749148c610f25be4d8)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:46.717227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:46.829859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0ac7e80c3f46749148c610f25be4d8', 'request_id': 'req-547801e7-81b6-4bb5-abed-278463311756'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.898037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0ac7e80c3f46749148c610f25be4d8', 'request_id': 'req-547801e7-81b6-4bb5-abed-278463311756'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.904693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0ac7e80c3f46749148c610f25be4d8', 'request_id': 'req-547801e7-81b6-4bb5-abed-278463311756'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.916234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] The token cache is being invalidate because project df0ac7e80c3f46749148c610f25be4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:46.916527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.917192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:46.918884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1027/2040] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:46 2022] DELETE /identity/v3/projects/df0ac7e80c3f46749148c610f25be4d8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:46.923115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:46.934789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9c64-4652-4f04-83c0-216da402521b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.004141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.005627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.006271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.006271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] PATH_INFO: `/v3/users/98779b654bfd4fb497077f9885f74d0d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.007425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=98779b654bfd4fb497077f9885f74d0d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.009406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.209242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:47.210836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:47.230211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547801e7-81b6-4bb5-abed-278463311756 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.235322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.240059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.240059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.240059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] PATH_INFO: `/v3/projects/c059d18afc344fddab02bfa8da065a6b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.240059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c059d18afc344fddab02bfa8da065a6b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.242086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.249797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98779b654bfd4fb497077f9885f74d0d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.250471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98779b654bfd4fb497077f9885f74d0d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.251137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98779b654bfd4fb497077f9885f74d0d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.348476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98779b654bfd4fb497077f9885f74d0d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.361888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c9e03af3-f386-44dc-a2d4-bfa5633fd0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98779b654bfd4fb497077f9885f74d0d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.378135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c059d18afc344fddab02bfa8da065a6b', 'request_id': 'req-e9cd8b38-783a-4dec-8099-e8a6b015e837'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.388694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1014/2041] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:46 2022] DELETE /identity/v3/users/98779b654bfd4fb497077f9885f74d0d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:47.460234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c059d18afc344fddab02bfa8da065a6b', 'request_id': 'req-e9cd8b38-783a-4dec-8099-e8a6b015e837'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.469765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c059d18afc344fddab02bfa8da065a6b', 'request_id': 'req-e9cd8b38-783a-4dec-8099-e8a6b015e837'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.500213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] The token cache is being invalidate because project c059d18afc344fddab02bfa8da065a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:47.500512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.501915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-e9cd8b38-783a-4dec-8099-e8a6b015e837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:47.504610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1028/2042] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:47 2022] DELETE /identity/v3/projects/c059d18afc344fddab02bfa8da065a6b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:47.511862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.515860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.515860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.532823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:47.534382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:47.599963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1015/2043] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:47.609558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.610229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.610617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.633396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:47.634618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:47.643926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1029/2044] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:47.648265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:47.659591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0599-16a8-447b-85a1-ac5ba289bbbc None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.677575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.678263 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.678761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.679048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.679982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:47.680295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.681923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.698688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1016/2045] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:47.699697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:47.709153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb800c6-2410-484e-b19c-27be87cc4042 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.714392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.715057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.715345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.715666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.716374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.718426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.824983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1030/2046] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:47 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:47.829043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:47.839546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca8996-16be-430e-8603-1d9978eb9f1d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.882869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:47.891826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:47.897988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.898682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.898963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.899246 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.899989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.902096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.915816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017cb02-0935-4c9b-93ff-9795c79d6d55 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:47.919674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:47.920658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:47.921033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:47.921358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] PATH_INFO: `/v3/projects/e0eea60572fd4695b752d619b25f51ea` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:47.922627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0eea60572fd4695b752d619b25f51ea)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:47.924945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:47.996782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1017/2047] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:47 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:47.999948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.009699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732d36-55c6-45ed-a50b-5f466b9c19fd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.015153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.015866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.016158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.016560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.017235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.019234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.030253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1018/2048] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:48.035503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.046190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0599000-4e3d-4bd6-910a-50b039bfb164 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.046995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0eea60572fd4695b752d619b25f51ea', 'request_id': 'req-bdf0669d-0ae5-4abe-a118-f606a9f433ff'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.108888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.109563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.109848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.110129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.110857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.112598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.121514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0eea60572fd4695b752d619b25f51ea', 'request_id': 'req-bdf0669d-0ae5-4abe-a118-f606a9f433ff'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.124235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1019/2049] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:48.125077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.129667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.130865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0eea60572fd4695b752d619b25f51ea', 'request_id': 'req-bdf0669d-0ae5-4abe-a118-f606a9f433ff'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.146327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f66a1-10f0-4996-9705-5037c33b8082 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.147659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] The token cache is being invalidate because project e0eea60572fd4695b752d619b25f51ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:48.148223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.149799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.152150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1031/2050] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:47 2022] DELETE /identity/v3/projects/e0eea60572fd4695b752d619b25f51ea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:48.153306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.158115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.160313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.162001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.162458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.162742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] PATH_INFO: `/v3/users/43c56fc1a41f44eaaf7e484ab4174ba8` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.164117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c56fc1a41f44eaaf7e484ab4174ba8)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.166072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.186417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0669d-0ae5-4abe-a118-f606a9f433ff admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.192217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.193122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.193412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.193690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] PATH_INFO: `/v3/projects/d211f9f8ed61413c8dec407c19423a12/users/30bcaba2a88c47f790aa01915d28ae01/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.212014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d211f9f8ed61413c8dec407c19423a12, user_id=30bcaba2a88c47f790aa01915d28ae01, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.214962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fec2b-ac25-4d32-95a5-3cf7b960f14c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.309490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1032/2051] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:48 2022] PUT /identity/v3/projects/d211f9f8ed61413c8dec407c19423a12/users/30bcaba2a88c47f790aa01915d28ae01/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:48.311549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934fa1-3ece-44c5-9b76-1ae56168bcc4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.312035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934fa1-3ece-44c5-9b76-1ae56168bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.312318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934fa1-3ece-44c5-9b76-1ae56168bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.338220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-68934fa1-3ece-44c5-9b76-1ae56168bcc4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:48.339421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68934fa1-3ece-44c5-9b76-1ae56168bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.359004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c56fc1a41f44eaaf7e484ab4174ba8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.360285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c56fc1a41f44eaaf7e484ab4174ba8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.361849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c56fc1a41f44eaaf7e484ab4174ba8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.401009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1033/2052] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:48.401009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab66a9-8587-4feb-9c41-d08d2869ed40 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.401009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab66a9-8587-4feb-9c41-d08d2869ed40 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.401009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab66a9-8587-4feb-9c41-d08d2869ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.429747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c56fc1a41f44eaaf7e484ab4174ba8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.434424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-13ab66a9-8587-4feb-9c41-d08d2869ed40 None None] MFA Rules not processed for user `30bcaba2a88c47f790aa01915d28ae01`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:48.434980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-13ab66a9-8587-4feb-9c41-d08d2869ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.437243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-5b0f6045-ade6-46f1-82a9-ad7cd82c439e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c56fc1a41f44eaaf7e484ab4174ba8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:48.453964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1020/2053] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:48 2022] DELETE /identity/v3/users/43c56fc1a41f44eaaf7e484ab4174ba8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:48.456930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.456930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.456930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.474478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:48.475285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.501410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1034/2054] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:48.503116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.506712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.506712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.523234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:48.524470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.546772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1021/2055] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:48.550521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.550521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.563935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3325-760e-4e6a-ad60-3af15333f660 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.570689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.571533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.571927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.572392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.573276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.575280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.586881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1035/2056] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:48.588387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.602119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3c1ab-b84f-45f4-811c-50ea0ede91ae None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.607322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.608035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.608324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.608601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.609335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:48.609641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.611285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.626631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1036/2057] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:48.626631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.626631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:48.654569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1022/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:48.659642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.688552 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441bbe0-2d10-47fa-9224-da0b44a07690 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.721397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb7f-8e75-4df1-b281-51a0821601c3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.726892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.727764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.728124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.728472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.729363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.731349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.739671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.740329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.740615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.740890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.750652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.752138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.762306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1037/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:48.762873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.776411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387741-888b-4053-a01e-10499f17c213 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.784656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.785189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.785569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.785911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.787063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.789036 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.839248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1023/2060] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:48.843235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.907226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9111c7-172a-4a1d-b07e-dfedb49f7648 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.912237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.912908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.913192 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.913465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.914155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.915676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1038/2061] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:48.918992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.919737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.930206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f563a-2b88-45b3-8055-760bc3a8b89a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.934942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.935611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.935894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.936166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.936994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.938575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:48.949364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1039/2062] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:48.953346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:48.963685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388be95-b6b8-402d-b809-96f0c11125d6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:48.968481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:48.969370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:48.969656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:48.970084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] PATH_INFO: `/v3/projects/40bfdcf7972941a4a986b9939834bc39/users/ce6d61e5031144e68dd579315dcb4729/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:48.986634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfdcf7972941a4a986b9939834bc39, user_id=ce6d61e5031144e68dd579315dcb4729, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:48.989923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.011177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1024/2063] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:48 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:49.013736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.023777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f50a0-62a4-4224-8ece-27a35541c955 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.028638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.029272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.029555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.029831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.030895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.032559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.046095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1025/2064] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:49.047363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.062106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020b03-9dc3-447e-b1df-89e116e698fb admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.087603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1040/2065] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:48 2022] PUT /identity/v3/projects/40bfdcf7972941a4a986b9939834bc39/users/ce6d61e5031144e68dd579315dcb4729/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:49.088764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.125112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.125698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.125984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.126264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.126986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.128656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.139043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1026/2066] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:49.143039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.152973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883efb-cddf-4bea-9992-d4f570354b0e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.159946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.162311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1593c69-1786-43d4-b0b2-3354a7b08dcd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.162435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.162435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.162435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] PATH_INFO: `/v3/projects/c83371f1cf9c49c2a7049c9e3d0cebb5/users/300891a3de5b415b81fa2b6f62db55f1/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.172065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.172898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.173486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.173879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.174978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.177723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.180926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83371f1cf9c49c2a7049c9e3d0cebb5, user_id=300891a3de5b415b81fa2b6f62db55f1, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.183678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92895c9-0972-447e-aad5-2c8bfc530b4b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.188188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1041/2067] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:49.192868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.203293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22e37-551f-457d-977b-8a116461fc95 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.209749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.209749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.209974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.210070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] PATH_INFO: `/v3/projects/40bfdcf7972941a4a986b9939834bc39/users/ce6d61e5031144e68dd579315dcb4729/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.212102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bfdcf7972941a4a986b9939834bc39, user_id=ce6d61e5031144e68dd579315dcb4729, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.214767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.225325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1042/2068] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:49 2022] PUT /identity/v3/projects/40bfdcf7972941a4a986b9939834bc39/users/ce6d61e5031144e68dd579315dcb4729/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:49.234231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.234231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.281555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1027/2069] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:49 2022] PUT /identity/v3/projects/c83371f1cf9c49c2a7049c9e3d0cebb5/users/300891a3de5b415b81fa2b6f62db55f1/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:49.282948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163429-f43f-4248-92e3-ca2c37c4909b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.283238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163429-f43f-4248-92e3-ca2c37c4909b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.283538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163429-f43f-4248-92e3-ca2c37c4909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.306542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81976e-f961-4493-9f27-dc526f4648e1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.311212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-de163429-f43f-4248-92e3-ca2c37c4909b None None] MFA Rules not processed for user `ce6d61e5031144e68dd579315dcb4729`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:49.312644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-de163429-f43f-4248-92e3-ca2c37c4909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.362926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.363881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.364712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.364982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] PATH_INFO: `/v3/projects/b73abe0806df487fbf320be296abfd90` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.366198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73abe0806df487fbf320be296abfd90)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.368202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.385966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1028/2070] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:49.387463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.387779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.388060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.417509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] MFA Rules not processed for user `300891a3de5b415b81fa2b6f62db55f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:49.418720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.485297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1029/2071] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:49.486234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.487691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.498393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73abe0806df487fbf320be296abfd90', 'request_id': 'req-8367ad1f-5aa8-4239-b595-5b0907061aaf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.542733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f09e2d-fe68-437b-b75a-4db15f468604 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.577405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73abe0806df487fbf320be296abfd90', 'request_id': 'req-8367ad1f-5aa8-4239-b595-5b0907061aaf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.584269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73abe0806df487fbf320be296abfd90', 'request_id': 'req-8367ad1f-5aa8-4239-b595-5b0907061aaf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.590408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.592529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.592529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.592529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.595823 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] The token cache is being invalidate because project b73abe0806df487fbf320be296abfd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:49.596115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.596784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.598862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1043/2072] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:49 2022] DELETE /identity/v3/projects/b73abe0806df487fbf320be296abfd90 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:49.599630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.600905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.651499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.652992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.663570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367ad1f-5aa8-4239-b595-5b0907061aaf admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.664000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1030/2073] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:49.664444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.669357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.672925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.672925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.672925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.672925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.673435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.675419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fb83c-ed83-4673-914e-c3dc9257acb7 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.680913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.681856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.682171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.682451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] PATH_INFO: `/v3/users/ee5c3d31bc604bcf98b8e1af01ba5e4a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.683720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5c3d31bc604bcf98b8e1af01ba5e4a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.685721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.765147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1044/2074] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:49 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:49.765147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.828655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f6c2-c8ac-4880-9f98-aabdce4c1576 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:49.833914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:49.834767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:49.835069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:49.835364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:49.836089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:49.838049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:49.850991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5c3d31bc604bcf98b8e1af01ba5e4a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.851765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5c3d31bc604bcf98b8e1af01ba5e4a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.852522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5c3d31bc604bcf98b8e1af01ba5e4a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.911822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1045/2075] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:49 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:49.912893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.914557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.927898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5c3d31bc604bcf98b8e1af01ba5e4a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.935558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5c3d31bc604bcf98b8e1af01ba5e4a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:49.958798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1031/2076] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:49 2022] DELETE /identity/v3/users/ee5c3d31bc604bcf98b8e1af01ba5e4a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:49.962579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:49.964077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:49.978402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114985-7ebd-497d-aac1-23f6dfa393b3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.036436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.037535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.037649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.037843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.042100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f86da-4fce-4801-95f0-3f73b9af03ee admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.044409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.048454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.048915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.049302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.049928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.051101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.053072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.067732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1032/2077] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:50.072245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.088865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a1a35-c02b-487c-b8fd-3a4479eed9e5 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.095802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.096492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.096776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.097056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.097796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.099462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.109797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1033/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:50.116597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.119410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.120900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be33db2-745b-4667-a754-137747cd7d0b service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.127520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a85a0-0ee2-4f2b-a743-1c66d0c4f854 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.131573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1046/2079] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:50.133873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.134922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.135218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.135602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] PATH_INFO: `/v3/projects/06159fc05f894739babaedcfa75f1de1/users/8eb5c42d058c48a59f1f0f3765f59e04/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.151204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=06159fc05f894739babaedcfa75f1de1, user_id=8eb5c42d058c48a59f1f0f3765f59e04, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.153964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.217128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1034/2080] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:50 2022] PUT /identity/v3/projects/06159fc05f894739babaedcfa75f1de1/users/8eb5c42d058c48a59f1f0f3765f59e04/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:50.229476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.229962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.230350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.265054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] MFA Rules not processed for user `8eb5c42d058c48a59f1f0f3765f59e04`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:50.266530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.335010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1047/2081] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:50.345125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.409818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb54ce2-168d-4618-8692-9771356ea9db admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.414325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.414991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.415695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.415988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.416099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.416277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.416984 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.418919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.432689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d1eec-6ce4-4652-bbc3-d7aa13799941 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.439637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.439637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.439637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.439637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] PATH_INFO: `/v3/projects/df77fca2274943ae9233b090ab4a59c9` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.441131 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df77fca2274943ae9233b090ab4a59c9)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.443707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.529027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1035/2082] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:50.535130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.595118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df77fca2274943ae9233b090ab4a59c9', 'request_id': 'req-af399e0b-63a2-414e-ba40-85487f7db18e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:50.600148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a581905-c20a-4433-9eb9-71357c778167 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.655421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.656237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.656523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.656802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.657485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.659403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb43cc-d802-44c8-94e9-b93e899b9595 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.703536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df77fca2274943ae9233b090ab4a59c9', 'request_id': 'req-af399e0b-63a2-414e-ba40-85487f7db18e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:50.710265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df77fca2274943ae9233b090ab4a59c9', 'request_id': 'req-af399e0b-63a2-414e-ba40-85487f7db18e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:50.720338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] The token cache is being invalidate because project df77fca2274943ae9233b090ab4a59c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:50.720627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:50.721277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-af399e0b-63a2-414e-ba40-85487f7db18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:50.723182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1048/2083] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:50 2022] DELETE /identity/v3/projects/df77fca2274943ae9233b090ab4a59c9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:50.727830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.728119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.728395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.747268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:50.748816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.767209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1049/2084] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:50.767431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1036/2085] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:50.767582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.767847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.768925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.769222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.769506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.780536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a900a2-3ee6-4cd7-ad36-6eaf534efef6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.786629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.788091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.788091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.788091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.788756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.789237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:50.790357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.790530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:50.798817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1037/2086] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:50.801060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1050/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:50.804527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.805585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.813602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9c9b-88d1-49c9-b101-3ce276e2ccef None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.816790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc988622-458c-474a-82b9-6f9c25b490ed admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.818343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.818992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.819281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.819598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.819744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.820343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:50.820594 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.820759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.820886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.821144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] PATH_INFO: `/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15/users/933d79be24bc43b3b86eb70b0b330a00/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.822367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.837161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1038/2088] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:50.840579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebdde6b65aa4d48b7410e09edef6e15, user_id=933d79be24bc43b3b86eb70b0b330a00, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.840755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.840868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.847598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b169c8-fff6-478d-9f56-6e242b395bd5 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:50.852946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:50.853498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:50.853834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:50.854168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:50.854803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:50.856752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:50.948797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1051/2089] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:50 2022] PUT /identity/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15/users/933d79be24bc43b3b86eb70b0b330a00/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:50.950539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:50.968960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1039/2090] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:50.972612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.052603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b10d7-8332-4491-a822-bc62372fee20 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.058179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.058848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.059135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.059412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.060143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdff4bd-4329-497b-b56e-29e37148fd32 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.060605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.062034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.064986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.065652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.065939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.066221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.066907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.068922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.072236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1052/2091] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:51.076401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.086311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798db8-b992-45d9-8a40-6d246524bf63 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.091049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.093115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.093115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.093115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] PATH_INFO: `/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15/users/933d79be24bc43b3b86eb70b0b330a00/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.095080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebdde6b65aa4d48b7410e09edef6e15, user_id=933d79be24bc43b3b86eb70b0b330a00, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.098977 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e226-9d7e-4b02-a53b-4bbea49ee852 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.111428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1053/2092] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:51 2022] PUT /identity/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15/users/933d79be24bc43b3b86eb70b0b330a00/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:51.122615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.122976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.123322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.151663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] MFA Rules not processed for user `933d79be24bc43b3b86eb70b0b330a00`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:51.152901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:51.175509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1040/2093] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:50 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:51.177127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.192209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04c909-0426-43ed-98a2-12877d82a8c6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.232843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1054/2094] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:51.245695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.250087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:51.253508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.254362 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.254733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.255082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.256106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.257658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.272310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1041/2095] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:51.273361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.284972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9c33-5c61-48bf-a699-a7a169ed162c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.293178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.293842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.294129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.294407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.295130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.297113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.308668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1042/2096] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:51.313352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.314099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9425e8-335c-49f6-bd9a-cfde58c4d2e3 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.317840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.318487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.318778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.319065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.320953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:51.324394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3c6f-9f46-42ad-a644-e838550a0d38 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.329866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.330916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.331800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.332086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] PATH_INFO: `/v3/projects/7d5bf413b83c464c9dc070bc276a4f0a/users/9eed33b661ee49a593f6cd94c8ae8827/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.347916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5bf413b83c464c9dc070bc276a4f0a, user_id=9eed33b661ee49a593f6cd94c8ae8827, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.351355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.381160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.382634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544fb7-f485-46c2-ad1d-d44f0531baab service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.392696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1055/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:51.488905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1043/2098] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:51 2022] PUT /identity/v3/projects/7d5bf413b83c464c9dc070bc276a4f0a/users/9eed33b661ee49a593f6cd94c8ae8827/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:51.504347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.505100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.505388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.540344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] MFA Rules not processed for user `9eed33b661ee49a593f6cd94c8ae8827`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:51.541161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:51.609112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1056/2099] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:51.627706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:51.630071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:51.686378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f5df-cd86-4b1f-ba32-dc39ce26f6f3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:51.690375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:51.691073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:51.691363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:51.691700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:51.700645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:51.702088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:51.711960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1044/2100] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:53.707091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:53.716945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c7d61-b988-49ee-95e3-15d08953d551 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:53.720866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:53.721518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:53.721799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:53.722074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:53.723951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:53.783030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:53.784510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb8226-30cb-459f-a098-4123a911c4ed service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:53.794107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1057/2101] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:54.722328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:54.724489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:54.828882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a358e6-ddb2-4933-8983-f5d130d74f37 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:54.834022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:54.834935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:54.835220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:54.835551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] PATH_INFO: `/v3/users/30bcaba2a88c47f790aa01915d28ae01` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:54.836888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bcaba2a88c47f790aa01915d28ae01)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:54.838808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:55.084274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bcaba2a88c47f790aa01915d28ae01'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:55.084939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bcaba2a88c47f790aa01915d28ae01'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:55.085541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bcaba2a88c47f790aa01915d28ae01'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:55.166308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bcaba2a88c47f790aa01915d28ae01'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:55.173968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bcaba2a88c47f790aa01915d28ae01'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:55.191540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1045/2102] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:54 2022] DELETE /identity/v3/users/30bcaba2a88c47f790aa01915d28ae01 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:55.196840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:55.198657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:55.198657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:55.214913 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:55.216153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:55.278784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1058/2103] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:55.294415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:55.295822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:55.354099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99c9a2-7e49-4c32-ba3e-89e991351179 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:55.357836 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:55.358486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:55.358775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:55.359135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:55.369743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:55.371134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:55.381242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1046/2104] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:04:55.398868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:55.400774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:55.461033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faace09-01c8-45bc-a72e-17cc896505fb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:55.464925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:55.465717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:55.465936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:55.466221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:55.468068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:55.530813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:55.532310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:55.542501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1059/2105] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:55.850201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:55.862914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:55.865710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104cc64-9015-4bc2-8016-10819104178f service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:55.870838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:55.871916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:55.872198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:55.872644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] PATH_INFO: `/v3/projects/d211f9f8ed61413c8dec407c19423a12` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:55.874158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d211f9f8ed61413c8dec407c19423a12)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:55.877241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:56.011158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd211f9f8ed61413c8dec407c19423a12', 'request_id': 'req-66a6651f-b37e-4808-9d47-57005c295e31'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.038395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:56.039942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:56.057896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d34f1-88ce-411c-ba7a-82ce073c8161 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:56.075754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd211f9f8ed61413c8dec407c19423a12', 'request_id': 'req-66a6651f-b37e-4808-9d47-57005c295e31'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.082375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd211f9f8ed61413c8dec407c19423a12', 'request_id': 'req-66a6651f-b37e-4808-9d47-57005c295e31'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.097661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] The token cache is being invalidate because project d211f9f8ed61413c8dec407c19423a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:56.098222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.099350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.104512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1047/2106] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:55 2022] DELETE /identity/v3/projects/d211f9f8ed61413c8dec407c19423a12 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:56.108188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:56.108188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:56.112711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:56.113818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:56.114109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:56.114384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] PATH_INFO: `/v3/users/9eed33b661ee49a593f6cd94c8ae8827` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:56.116608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eed33b661ee49a593f6cd94c8ae8827)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:56.118768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:56.124579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6651f-b37e-4808-9d47-57005c295e31 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:56.131346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:56.132922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:56.141905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:56.141905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] PATH_INFO: `/v3/users/ce6d61e5031144e68dd579315dcb4729` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:56.141905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6d61e5031144e68dd579315dcb4729)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:56.141905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:56.433200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eed33b661ee49a593f6cd94c8ae8827'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.434039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eed33b661ee49a593f6cd94c8ae8827'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.434361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6d61e5031144e68dd579315dcb4729'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.434654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eed33b661ee49a593f6cd94c8ae8827'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.434954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6d61e5031144e68dd579315dcb4729'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.435582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6d61e5031144e68dd579315dcb4729'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.611825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eed33b661ee49a593f6cd94c8ae8827'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.622430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b749efec-9e10-4dfa-b0df-15a3a5a99b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eed33b661ee49a593f6cd94c8ae8827'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.634713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1060/2107] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:56 2022] DELETE /identity/v3/users/9eed33b661ee49a593f6cd94c8ae8827 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:56.638994 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:56.640154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:56.640154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:56.657151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:56.658396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:56.686798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6d61e5031144e68dd579315dcb4729'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.695034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6d61e5031144e68dd579315dcb4729'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:56.713982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1048/2108] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:56 2022] DELETE /identity/v3/users/ce6d61e5031144e68dd579315dcb4729 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:56.733081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1061/2109] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:56.749243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:56.750687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:56.841683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8293e-8f4a-47ea-a2bf-2334c9304d8b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:56.847312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:56.848071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:56.848358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:56.850512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:56.937674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:56.940889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:56.956458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1049/2110] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:57.229157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.230743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.243623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94627e5d-c6a9-47bb-b7bf-d78fe09fcb27 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.248555 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.249423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.249714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.249980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] PATH_INFO: `/v3/projects/40bfdcf7972941a4a986b9939834bc39` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.251626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bfdcf7972941a4a986b9939834bc39)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.253596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.378070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bfdcf7972941a4a986b9939834bc39', 'request_id': 'req-222c502a-00ea-4182-9251-01b687031bc4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.456025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bfdcf7972941a4a986b9939834bc39', 'request_id': 'req-222c502a-00ea-4182-9251-01b687031bc4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.460266 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bfdcf7972941a4a986b9939834bc39', 'request_id': 'req-222c502a-00ea-4182-9251-01b687031bc4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.460542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.462577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.475822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] The token cache is being invalidate because project 40bfdcf7972941a4a986b9939834bc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:57.481784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.481784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-222c502a-00ea-4182-9251-01b687031bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.481784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1062/2111] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:57 2022] DELETE /identity/v3/projects/40bfdcf7972941a4a986b9939834bc39 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:57.483827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89973-1653-45ea-8a8a-a9fa083c9e1e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.484280 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89973-1653-45ea-8a8a-a9fa083c9e1e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.484727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89973-1653-45ea-8a8a-a9fa083c9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.488512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ac73-4475-45fb-9bd1-4a4fb40e1476 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.512621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9da89973-1653-45ea-8a8a-a9fa083c9e1e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:57.513816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9da89973-1653-45ea-8a8a-a9fa083c9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.544675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.545517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.545800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.546073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] PATH_INFO: `/v3/projects/7d5bf413b83c464c9dc070bc276a4f0a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.547243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5bf413b83c464c9dc070bc276a4f0a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.549575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.573609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1063/2112] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:57.581387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.581716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.582129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.606052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:57.606052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.618075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1064/2113] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:57.622045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.631265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a473edd-6a2d-487d-b426-da5ed945cd2a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.636262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.636911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.637191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.637465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.638263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:57.638687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.640447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.655211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1065/2114] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:04:57.656254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.666160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa784e-15ed-41ed-ab75-64e5efa7f9e7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.670212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5bf413b83c464c9dc070bc276a4f0a', 'request_id': 'req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.723317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.724584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.724967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.725485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.726034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.727992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.737618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5bf413b83c464c9dc070bc276a4f0a', 'request_id': 'req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.744511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5bf413b83c464c9dc070bc276a4f0a', 'request_id': 'req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.756100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] The token cache is being invalidate because project 7d5bf413b83c464c9dc070bc276a4f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:04:57.756394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.757050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1751b3-ddbb-4e0a-8123-3ee9580ac553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:57.758614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1050/2115] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:04:57 2022] DELETE /identity/v3/projects/7d5bf413b83c464c9dc070bc276a4f0a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:57.763237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9fcb-b65b-40cd-89d5-52ec4d2e831f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.763559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9fcb-b65b-40cd-89d5-52ec4d2e831f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.763841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9fcb-b65b-40cd-89d5-52ec4d2e831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.781099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-13bd9fcb-b65b-40cd-89d5-52ec4d2e831f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:57.782351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-13bd9fcb-b65b-40cd-89d5-52ec4d2e831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.790967 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1051/2116] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:57.798272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.798564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.798842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.817901 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:57.819220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.828061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1052/2117] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:57.831259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1066/2118] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:57.831994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.835035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.836737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:57.841407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10503611-97cc-43f7-b53a-96c12f08da1d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.900121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.901223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e9d22-5cc2-4456-9c09-c67d598fdd66 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.901558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.901968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.902313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.903147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:04:57.903572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.905494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.906746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.907771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.907902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.908208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.908967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.911816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:57.923406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1053/2119] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:04:57.924914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:57.934882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef663-23c4-4491-8c74-aa467ea6241b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:57.941588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:57.941588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:57.941588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:57.941588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:57.941986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:57.943430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.035242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1067/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:58.040160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1054/2121] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:57 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:58.041243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.041405 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.051166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b5871-ab66-4af0-8059-a6af409cac3e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.102955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923215c3-0a0b-407e-812c-73f6f3858174 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.106784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.107487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.107849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.107956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.108062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.108498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.108768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.108867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.109051 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.109783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.110375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.111743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.121003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1068/2122] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:58.124953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.135170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897205-c8fe-49f7-8f3b-0a979eb233be admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.140286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.140949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.141327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.141506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.142231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.143846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.154353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1069/2123] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:58.158763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.169250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f9639-62de-4d76-a103-ecb838c924d9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.174011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.175141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.175428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.175767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] PATH_INFO: `/v3/projects/c5d1cac677df4e4c8c8bc214d2b5c5e9/users/f1dcadcaceeb44a1ae3b77ad6099cff6/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.189705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d1cac677df4e4c8c8bc214d2b5c5e9, user_id=f1dcadcaceeb44a1ae3b77ad6099cff6, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.192512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.196399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1055/2124] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:58 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:04:58.205416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.215370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1286b3-07ed-4eb3-a6ec-7a0d3736ec77 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.220329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.220974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.221260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.221540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.222363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.224692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.234597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1056/2125] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:58.238081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.247360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498add78-2fb8-4a2b-8c6a-f70fedc3d431 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.251992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.252589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.252873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.253149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.253828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.255989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fe6e-abe5-46ce-92ad-1ef35f52f2a4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.262777 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1070/2126] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:58 2022] PUT /identity/v3/projects/c5d1cac677df4e4c8c8bc214d2b5c5e9/users/f1dcadcaceeb44a1ae3b77ad6099cff6/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:58.265557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1057/2127] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:04:58.269375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.273697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.273991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.274267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.300614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] MFA Rules not processed for user `f1dcadcaceeb44a1ae3b77ad6099cff6`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:58.301886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:58.329864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88c83-59f2-4426-bdea-d9777c8d4c58 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.335119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.336034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.336352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.336629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] PATH_INFO: `/v3/projects/b2f73b1e0a1347a8904c662844ebd9d3/users/73c4353695e24961856ad4b8ec9fb20b/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.350910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f73b1e0a1347a8904c662844ebd9d3, user_id=73c4353695e24961856ad4b8ec9fb20b, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.353664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b030490-2842-47b1-ba7b-607bce092efd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.365083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1058/2128] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:58.369445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.379357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba85f-9ef0-4dbd-9fc0-5c055aacec0b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.384672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.386342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.386342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.386342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.386783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.388753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.446307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1071/2129] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:58 2022] PUT /identity/v3/projects/b2f73b1e0a1347a8904c662844ebd9d3/users/73c4353695e24961856ad4b8ec9fb20b/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:04:58.451316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.451646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.451928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.468971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:58.470163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:58.506790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1059/2130] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:04:58 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:58.511278 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.529553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1072/2131] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:04:58.538964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.540514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:58.602885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15e89-7ae6-4a6b-8c69-287bf39a9adf admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.603448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1ac7-8aac-4a58-984b-ab7e777ce17e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.608294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.608631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.608909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.609186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.609873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.611953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.652007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.653161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.653694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.653984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.669535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.669535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.675355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1073/2132] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:58.716917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1060/2133] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:04:58 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:04:58.726099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.736022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd250c2-de71-4016-9d24-a25708a9e270 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.741410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.742269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.742537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.742815 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.743639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.749365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.756095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1074/2134] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:58.760415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.770983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f697e06-ded6-4802-b053-563eb052087c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.776424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.777510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.777800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.778074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] PATH_INFO: `/v3/projects/1407514003de43c6abc948552ef589ac/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.792892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1407514003de43c6abc948552ef589ac, user_id=9d33bd5bb1d6428c8d0c8a1dd26cebd5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.795676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.884185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1061/2135] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:58 2022] PUT /identity/v3/projects/1407514003de43c6abc948552ef589ac/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:58.885427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.895686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e283f-5c4f-46f0-a0c7-b941d829c960 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:58.960487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:58.961229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:58.961645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:58.961990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:58.962788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:58.964480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3922-ad57-4642-a7a0-5c88a8048de9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:58.978401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1075/2136] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:04:58.979797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:58.992313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b532d-a317-4057-b223-44c30dbe7d35 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:59.003169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:59.003169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:59.003169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:59.003169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] PATH_INFO: `/v3/projects/1407514003de43c6abc948552ef589ac/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:59.003504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1407514003de43c6abc948552ef589ac, user_id=9d33bd5bb1d6428c8d0c8a1dd26cebd5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:59.005426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:59.019685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1062/2137] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:04:58 2022] PUT /identity/v3/projects/1407514003de43c6abc948552ef589ac/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:59.033198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:59.036658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:59.036658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:59.076995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] MFA Rules not processed for user `9d33bd5bb1d6428c8d0c8a1dd26cebd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:59.079133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:59.147551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1076/2138] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:04:59.209917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:59.212044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:59.272741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a63be7-cc64-4bc0-aec6-41ccaa327847 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:59.277015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:59.277675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:59.277997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:59.278414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:59.292664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:59.294366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8d24-89fe-40a8-9579-12877912db4e service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:59.306050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1063/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:04:59.515166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:04:59.591587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8125bc-553a-49dc-a7e7-bd4fd6c828a1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:04:59.596927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:04:59.597796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:59.598135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:59.598343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] PATH_INFO: `/v3/users/f1dcadcaceeb44a1ae3b77ad6099cff6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:59.600208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1dcadcaceeb44a1ae3b77ad6099cff6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:04:59.602135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:04:59.799541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1dcadcaceeb44a1ae3b77ad6099cff6'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:59.800229 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1dcadcaceeb44a1ae3b77ad6099cff6'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:59.800870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1dcadcaceeb44a1ae3b77ad6099cff6'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:59.869279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1dcadcaceeb44a1ae3b77ad6099cff6'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:59.884540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1dcadcaceeb44a1ae3b77ad6099cff6'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:04:59.897957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1077/2140] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:04:59 2022] DELETE /identity/v3/users/f1dcadcaceeb44a1ae3b77ad6099cff6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:04:59.902779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8567-b132-4836-808d-9303272eeee5 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:04:59.903184 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8567-b132-4836-808d-9303272eeee5 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:04:59.903605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8567-b132-4836-808d-9303272eeee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:04:59.921868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a9dd8567-b132-4836-808d-9303272eeee5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:04:59.923082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a9dd8567-b132-4836-808d-9303272eeee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:04:59.991296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1064/2141] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:00.005559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:00.005559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.080353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318fe14-b4b0-4a5b-955f-8e26d1b2cf28 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:00.085506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:00.086172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.086464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.086744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.097896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:00.102828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:00.114645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1078/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:00.142985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.147732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.147732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.184946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] MFA Rules not processed for user `73c4353695e24961856ad4b8ec9fb20b`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:00.186757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.274207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1065/2143] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:00.285742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:00.287445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.383871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03931cf1-1814-401e-b602-3894c250f5ad service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:00.387090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:00.387786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.388069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.388341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.398806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:00.400826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:00.412219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1079/2144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:00.634279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:00.634279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.657976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda56d-64d6-4cfc-aea2-cca6689094e9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:00.669118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:00.670001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.670287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.670563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] PATH_INFO: `/v3/projects/c5d1cac677df4e4c8c8bc214d2b5c5e9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.672023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d1cac677df4e4c8c8bc214d2b5c5e9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:00.673968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:00.768589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:00.770159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.775609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d1cac677df4e4c8c8bc214d2b5c5e9', 'request_id': 'req-4e585d69-418e-4065-b1f4-ed39fc5e2872'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:00.784340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2d9a-19a0-4ab8-8630-e288c777bdb4 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:00.834864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d1cac677df4e4c8c8bc214d2b5c5e9', 'request_id': 'req-4e585d69-418e-4065-b1f4-ed39fc5e2872'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:00.841166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:00.841456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d1cac677df4e4c8c8bc214d2b5c5e9', 'request_id': 'req-4e585d69-418e-4065-b1f4-ed39fc5e2872'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:00.842031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.842331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.842601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] PATH_INFO: `/v3/users/300891a3de5b415b81fa2b6f62db55f1` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.844053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] RBAC: Authorizing `identity:delete_user(user_id=300891a3de5b415b81fa2b6f62db55f1)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:00.845986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:00.853045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] The token cache is being invalidate because project c5d1cac677df4e4c8c8bc214d2b5c5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:00.853521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:00.854180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:00.855741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1066/2145] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:00 2022] DELETE /identity/v3/projects/c5d1cac677df4e4c8c8bc214d2b5c5e9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:00.860405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:00.862316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:00.875230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585d69-418e-4065-b1f4-ed39fc5e2872 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:00.879979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:00.880839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:00.881127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:00.881410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] PATH_INFO: `/v3/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:00.882628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d33bd5bb1d6428c8d0c8a1dd26cebd5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:00.884608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:01.130444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300891a3de5b415b81fa2b6f62db55f1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.131436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300891a3de5b415b81fa2b6f62db55f1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.132236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300891a3de5b415b81fa2b6f62db55f1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.184301 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d33bd5bb1d6428c8d0c8a1dd26cebd5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.185347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d33bd5bb1d6428c8d0c8a1dd26cebd5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.186406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d33bd5bb1d6428c8d0c8a1dd26cebd5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.200359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300891a3de5b415b81fa2b6f62db55f1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.214068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ade89d9-7426-4003-8ae1-69b7b43634be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300891a3de5b415b81fa2b6f62db55f1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.226641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1080/2146] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:00 2022] DELETE /identity/v3/users/300891a3de5b415b81fa2b6f62db55f1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:01.231024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:01.231349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:01.231667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:01.249096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:01.250361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:01.263492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d33bd5bb1d6428c8d0c8a1dd26cebd5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.271293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d33bd5bb1d6428c8d0c8a1dd26cebd5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.288261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1067/2147] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:00 2022] DELETE /identity/v3/users/9d33bd5bb1d6428c8d0c8a1dd26cebd5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:01.309642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1081/2148] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:01.320386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:01.324349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:01.380938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1fcf-e7b4-4076-b424-7edb1e9364d4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:01.384579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:01.385227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:01.385511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:01.385791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:01.445910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:01.447364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:01.456728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1068/2149] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:01.738087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:01.740184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:01.751799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd397b-52c2-4686-9ec2-c8cbccbc1e45 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:01.758882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:01.759793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:01.760080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:01.760361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] PATH_INFO: `/v3/projects/1407514003de43c6abc948552ef589ac` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:01.761761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1407514003de43c6abc948552ef589ac)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:01.763906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:01.908982 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1407514003de43c6abc948552ef589ac', 'request_id': 'req-b15a5757-c9fe-42af-bbef-0b7486594e4d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.956873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:01.966499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:01.971270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c23eb-c29f-4750-bbdd-e05a1b3c29f5 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:01.978152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1407514003de43c6abc948552ef589ac', 'request_id': 'req-b15a5757-c9fe-42af-bbef-0b7486594e4d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.988783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1407514003de43c6abc948552ef589ac', 'request_id': 'req-b15a5757-c9fe-42af-bbef-0b7486594e4d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.996988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] The token cache is being invalidate because project 1407514003de43c6abc948552ef589ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:01.997276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:01.998193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b15a5757-c9fe-42af-bbef-0b7486594e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.000837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1082/2150] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:01 2022] DELETE /identity/v3/projects/1407514003de43c6abc948552ef589ac => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:02.005468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deb51a-4961-4ed6-8759-d8230eed9dfb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.005756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deb51a-4961-4ed6-8759-d8230eed9dfb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.006033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deb51a-4961-4ed6-8759-d8230eed9dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.030645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a8deb51a-4961-4ed6-8759-d8230eed9dfb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:02.031903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a8deb51a-4961-4ed6-8759-d8230eed9dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.037951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.038813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.039102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.039380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] PATH_INFO: `/v3/projects/c83371f1cf9c49c2a7049c9e3d0cebb5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.040683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83371f1cf9c49c2a7049c9e3d0cebb5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.042622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.090251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1083/2151] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:02.097834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.098170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.098943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.119830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:02.120801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.131429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1084/2152] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:02.141259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.151394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53581f-80e8-44af-81bc-41f52be63680 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.163152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83371f1cf9c49c2a7049c9e3d0cebb5', 'request_id': 'req-04f2807f-3fae-421c-9b55-9c9a3e53a026'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.208075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.208736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.209018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.209296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.210025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:05:02.210447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.212227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e339e59-055c-4c43-9bb4-c692b4c05838 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.224909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1085/2153] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:05:02.227417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.227660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.228061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.247362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] MFA Rules not processed for user `73c4353695e24961856ad4b8ec9fb20b`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:02.248729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.253977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83371f1cf9c49c2a7049c9e3d0cebb5', 'request_id': 'req-04f2807f-3fae-421c-9b55-9c9a3e53a026'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.262350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83371f1cf9c49c2a7049c9e3d0cebb5', 'request_id': 'req-04f2807f-3fae-421c-9b55-9c9a3e53a026'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.275309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] The token cache is being invalidate because project c83371f1cf9c49c2a7049c9e3d0cebb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:02.275643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.276328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.279512 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1069/2154] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:01 2022] DELETE /identity/v3/projects/c83371f1cf9c49c2a7049c9e3d0cebb5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:02.280363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.282224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.297087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2807f-3fae-421c-9b55-9c9a3e53a026 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.303353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.304130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.304490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.304888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.305798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.308172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.317780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1086/2155] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:02.319326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.322251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.338755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b69ac-0b0e-4b50-90cf-33c2449fa288 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.343535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.344403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.344685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.344958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] PATH_INFO: `/v3/users/8eb5c42d058c48a59f1f0f3765f59e04` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.346172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb5c42d058c48a59f1f0f3765f59e04)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.357746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.444929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1070/2156] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:05:02.446210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.508319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51dc4-f6b3-47b6-8f96-63c42a4c847b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.512954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.513630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.513954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.514198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.514889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.517172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.602813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb5c42d058c48a59f1f0f3765f59e04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.603520 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb5c42d058c48a59f1f0f3765f59e04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.604145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb5c42d058c48a59f1f0f3765f59e04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.626458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1071/2157] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:02.630377 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.632148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:02.644358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980fefd-d802-4b8b-9dd3-463bbeac4e6a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.649545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.650208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.650494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.650774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.653272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.653272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.665926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1072/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:05:02.669785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.674941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb5c42d058c48a59f1f0f3765f59e04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.685386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad6790-4124-4c4a-ac87-4bac319a5fef admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.688258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb5c42d058c48a59f1f0f3765f59e04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:02.691909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.692877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.693770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.694009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.695463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.697720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebbbfa-a2f9-49c7-89c4-5c73f6d3ad77 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.701980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1087/2159] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:02 2022] DELETE /identity/v3/users/8eb5c42d058c48a59f1f0f3765f59e04 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:02.718663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1073/2160] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:05:02.722582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:02.802949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755828-f30c-439a-a4b2-f8ae3be419b5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:02.808007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:02.808894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.809183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.809463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] PATH_INFO: `/v3/projects/f1f9c78ee578484baab95d130e153034/users/816a7742970142e9903eda59677982da/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.825433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9c78ee578484baab95d130e153034, user_id=816a7742970142e9903eda59677982da, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:02.828159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:02.912987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1088/2161] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:02 2022] PUT /identity/v3/projects/f1f9c78ee578484baab95d130e153034/users/816a7742970142e9903eda59677982da/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:02.915206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:02.915707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:02.916968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:02.972236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] MFA Rules not processed for user `816a7742970142e9903eda59677982da`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:02.974091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.056543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1074/2162] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:03.061326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.125801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ed7b-abc4-4c62-b29f-eab5b0a2118c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.131209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.131895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.132178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.132452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.133150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.135042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.162487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.165273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.180091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6c0e4-0ef6-4fd9-b7cf-e747d8e72aaf None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.184957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.185820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.186103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.186378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] PATH_INFO: `/v3/projects/06159fc05f894739babaedcfa75f1de1` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.187606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06159fc05f894739babaedcfa75f1de1)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.189621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.210243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1089/2163] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:03 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:05:03.214032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.276758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fb1a7-f0f7-4f57-8142-a8350bbcac1a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.281488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.282152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.282438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.282713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.283407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.285390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.303745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06159fc05f894739babaedcfa75f1de1', 'request_id': 'req-23c6ddc9-7890-494f-aebc-10154e9d87f5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.372200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06159fc05f894739babaedcfa75f1de1', 'request_id': 'req-23c6ddc9-7890-494f-aebc-10154e9d87f5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.379248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1090/2164] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:03 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:03.381877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06159fc05f894739babaedcfa75f1de1', 'request_id': 'req-23c6ddc9-7890-494f-aebc-10154e9d87f5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.383895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.394419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fdf4c-683b-4bbe-b005-bf9238376df1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.401323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] The token cache is being invalidate because project 06159fc05f894739babaedcfa75f1de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:03.401884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.402660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.405669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1075/2165] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:03 2022] DELETE /identity/v3/projects/06159fc05f894739babaedcfa75f1de1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:03.421001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.422544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.464871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.465550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.465837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.466114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.466848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.468484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.482324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1091/2166] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:03.486585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.490169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.506590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892a5f5-2c14-4bb6-9ddd-3ee58764b837 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.510811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ddc9-7890-494f-aebc-10154e9d87f5 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.512325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.513291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.513676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.514010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] PATH_INFO: `/v3/projects/4473b296920a4c03977effcf598b8f05/users/867e1bb6f64b488cb5cb9fc8d73170cd/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.515583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.516537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.516904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.517516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] PATH_INFO: `/v3/users/933d79be24bc43b3b86eb70b0b330a00` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.518824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933d79be24bc43b3b86eb70b0b330a00)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.520928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.529616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4473b296920a4c03977effcf598b8f05, user_id=867e1bb6f64b488cb5cb9fc8d73170cd, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.532622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.601483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1092/2167] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:03 2022] PUT /identity/v3/projects/4473b296920a4c03977effcf598b8f05/users/867e1bb6f64b488cb5cb9fc8d73170cd/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:03.605294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.670737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d527693-9811-4fd0-8bd7-10fe69d571ea admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.672282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933d79be24bc43b3b86eb70b0b330a00'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.673002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933d79be24bc43b3b86eb70b0b330a00'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.673627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933d79be24bc43b3b86eb70b0b330a00'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.675759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.676443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.677276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.677561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.678289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.679924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.689687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1093/2168] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:05:03.693772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.695856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.708894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679923-015e-4e8b-b093-3a90bb3226b4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.714504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.715449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.715834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.716200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] PATH_INFO: `/v3/projects/4473b296920a4c03977effcf598b8f05/users/867e1bb6f64b488cb5cb9fc8d73170cd/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.718079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4473b296920a4c03977effcf598b8f05, user_id=867e1bb6f64b488cb5cb9fc8d73170cd, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.720765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1388e-6fb6-48fd-b2c6-87ea3086ec26 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.726397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933d79be24bc43b3b86eb70b0b330a00'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.732327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1094/2169] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:03 2022] PUT /identity/v3/projects/4473b296920a4c03977effcf598b8f05/users/867e1bb6f64b488cb5cb9fc8d73170cd/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:03.734289 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933d79be24bc43b3b86eb70b0b330a00'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:03.744546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.744841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.745124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.756481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1076/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:03 2022] DELETE /identity/v3/users/933d79be24bc43b3b86eb70b0b330a00 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:03.777059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] MFA Rules not processed for user `867e1bb6f64b488cb5cb9fc8d73170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:03.778366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.847779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1095/2171] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:03.860141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:03.861598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:03.922711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f453ee-79ee-4fcc-a61c-a3f21289ad77 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:03.926674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:03.927313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:03.927631 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:03.927908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:03.937078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:03.938508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:03.948442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1077/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:04.191267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:04.200854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987058-96a0-40db-b72e-706c6d2ca263 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:04.204415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:04.205052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.205345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.205610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.207335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:04.227262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:04.228926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:04.270016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:04.272264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e598c-30e7-4eef-bfaa-29aa15c71e48 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:04.294430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1096/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:04.329933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaf48e-19a5-471d-bb34-9356921170db service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:04.336047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:04.337085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.337441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.337793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] PATH_INFO: `/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.339085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebdde6b65aa4d48b7410e09edef6e15)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:04.341287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:04.485003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebdde6b65aa4d48b7410e09edef6e15', 'request_id': 'req-c30d8adb-4912-4bcb-a57b-78cd616f79bc'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:04.543545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebdde6b65aa4d48b7410e09edef6e15', 'request_id': 'req-c30d8adb-4912-4bcb-a57b-78cd616f79bc'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:04.549868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebdde6b65aa4d48b7410e09edef6e15', 'request_id': 'req-c30d8adb-4912-4bcb-a57b-78cd616f79bc'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:04.561227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] The token cache is being invalidate because project 5ebdde6b65aa4d48b7410e09edef6e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:04.561515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:04.562224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c30d8adb-4912-4bcb-a57b-78cd616f79bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:04.563852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1078/2174] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:04 2022] DELETE /identity/v3/projects/5ebdde6b65aa4d48b7410e09edef6e15 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:04.569395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.569778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.570116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.589349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:04.590518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:04.656697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1097/2175] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:04.665777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.666061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.666338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.685103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:04.686292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:04.694907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1079/2176] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:04.699209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:04.710047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487608-f28b-4cfc-833b-c2cd5329aee4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:04.717345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:04.718034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.718316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.718937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.719704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:05:04.720019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:04.721632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:04.737951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1098/2177] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:05:04.738811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:04.749100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b97d9-bffb-43e1-ac9b-dd8ff6a53c45 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:04.753877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b018-e86e-453c-b625-842497859807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:04.754547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b018-e86e-453c-b625-842497859807 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.755443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b018-e86e-453c-b625-842497859807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.755825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313b018-e86e-453c-b625-842497859807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.756521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b018-e86e-453c-b625-842497859807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:04.758449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313b018-e86e-453c-b625-842497859807 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:04.836582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1080/2178] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:04 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:04.840545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:04.850548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a6e92-a9f5-47bd-8c87-25d0a3df7069 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:04.915595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:04.916313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:04.916599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:04.917054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:04.917746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:04.919712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:05.015987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1099/2179] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:04 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:05.017417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b018-e86e-453c-b625-842497859807 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:05.027940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313b018-e86e-453c-b625-842497859807 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:05.032743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:05.033487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:05.033813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:05.034096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:05.034820 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:05.036986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:05.048587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1081/2180] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:05.053576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:05.063506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c161-3e10-45bb-b229-906cddb3b359 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:05.068407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:05.069063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:05.069346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:05.069622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:05.070351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:05.071988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a9fb-053c-44cd-98cf-b48cf5b4fd72 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:05.081880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1100/2181] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:05.086009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:05.096736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dcef1-6cd2-4dce-8aac-a465829048bc admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:05.102279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:05.103159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:05.103446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:05.103762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] PATH_INFO: `/v3/projects/91a0fe7cf4f342fd972e60973badf7ce/users/de83af66daf44bbc8fe7b916187e22cf/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:05.120002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a0fe7cf4f342fd972e60973badf7ce, user_id=de83af66daf44bbc8fe7b916187e22cf, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:05.122810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:05.189983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1082/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:05 2022] PUT /identity/v3/projects/91a0fe7cf4f342fd972e60973badf7ce/users/de83af66daf44bbc8fe7b916187e22cf/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:05.195103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:05.195600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:05.195693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:05.214049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:05.216122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:05.278345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1101/2183] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:05.288658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:05.290337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:05.355646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bc820-13a4-4821-9c2b-eab30e8096a4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:05.359734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:05.362310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:05.362310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:05.362310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:05.371168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:05.372712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcbfcc-52e0-45b1-a75d-7227f55fc395 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:05.382598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1083/2184] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:10.958201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:10.959860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:10.974271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ede864-d758-45ce-b07d-7d8501c56e2a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:10.986084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:10.988416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:10.989687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:10.990112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] PATH_INFO: `/v3/users/816a7742970142e9903eda59677982da` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:10.992297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816a7742970142e9903eda59677982da)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:10.997006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:11.226584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dce04-a77e-4139-a133-534cb0cdf7ae None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:11.227153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dce04-a77e-4139-a133-534cb0cdf7ae None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:11.227153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dce04-a77e-4139-a133-534cb0cdf7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:11.230024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816a7742970142e9903eda59677982da'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:11.230864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816a7742970142e9903eda59677982da'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:11.231767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816a7742970142e9903eda59677982da'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:11.247030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-555dce04-a77e-4139-a133-534cb0cdf7ae None None] MFA Rules not processed for user `69b4c5f51c5943ef95fd751c67d2e901`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:11.248419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-555dce04-a77e-4139-a133-534cb0cdf7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:11.308720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816a7742970142e9903eda59677982da'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:11.325857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816a7742970142e9903eda59677982da'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:11.327745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1084/2185] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:11.339454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1102/2186] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:10 2022] DELETE /identity/v3/users/816a7742970142e9903eda59677982da => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:11.344243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:11.344576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:11.344864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:11.365163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:11.366398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:11.469292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1085/2187] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:11.479460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:11.481017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:11.552257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c76064-ffad-4e91-94e6-7618ea9763b6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:11.555928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:11.556583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:11.556871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:11.557148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:11.567505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:11.568991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:11.581018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1103/2188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:05:12.068944 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:12.071021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:12.089640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb249f8-2b71-41bd-bc87-2aa08ecd6ab2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:12.105450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:12.106552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:12.107783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:12.108146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] PATH_INFO: `/v3/projects/f1f9c78ee578484baab95d130e153034` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:12.110178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f9c78ee578484baab95d130e153034)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:12.112281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:12.252390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f9c78ee578484baab95d130e153034', 'request_id': 'req-c6f94042-9f01-4312-95a8-bd6c770dcb1a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.332993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f9c78ee578484baab95d130e153034', 'request_id': 'req-c6f94042-9f01-4312-95a8-bd6c770dcb1a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.339743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f9c78ee578484baab95d130e153034', 'request_id': 'req-c6f94042-9f01-4312-95a8-bd6c770dcb1a'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.353917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] The token cache is being invalidate because project f1f9c78ee578484baab95d130e153034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:12.353917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.359877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6f94042-9f01-4312-95a8-bd6c770dcb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.359877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1086/2189] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:12 2022] DELETE /identity/v3/projects/f1f9c78ee578484baab95d130e153034 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:12.361764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:12.378574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4086a-c9dd-4812-b4ad-9e52e2ba43f3 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:12.486263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:12.487378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:12.487708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:12.487988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] PATH_INFO: `/v3/users/867e1bb6f64b488cb5cb9fc8d73170cd` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:12.490134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867e1bb6f64b488cb5cb9fc8d73170cd)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:12.492449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:12.637677 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805792c9-218e-442e-a708-06fe122f7fab None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:12.638451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805792c9-218e-442e-a708-06fe122f7fab None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:12.638451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805792c9-218e-442e-a708-06fe122f7fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:12.672018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-805792c9-218e-442e-a708-06fe122f7fab None None] MFA Rules not processed for user `de83af66daf44bbc8fe7b916187e22cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:12.673353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-805792c9-218e-442e-a708-06fe122f7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:12.702069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867e1bb6f64b488cb5cb9fc8d73170cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.702743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867e1bb6f64b488cb5cb9fc8d73170cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.704008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867e1bb6f64b488cb5cb9fc8d73170cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.753960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1087/2190] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:12.758463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805792c9-218e-442e-a708-06fe122f7fab None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:12.760932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-805792c9-218e-442e-a708-06fe122f7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:12.775217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805792c9-218e-442e-a708-06fe122f7fab None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:12.780186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:12.780851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:12.781137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:12.781419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:12.782143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:12.784108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:12.791197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867e1bb6f64b488cb5cb9fc8d73170cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.820964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867e1bb6f64b488cb5cb9fc8d73170cd'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:12.841656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1104/2191] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:12 2022] DELETE /identity/v3/users/867e1bb6f64b488cb5cb9fc8d73170cd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:12.876576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1088/2192] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:12 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:12.877375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.024149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0734f-c80d-4d6c-8e43-bde8e68b8cf1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.088530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.089655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.089655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.089856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.090451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.092681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.178282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1105/2193] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:12 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:13.182351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.193531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c0c-1a35-4b9c-bcb6-5a21d26942c8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.213822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.214517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.214805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.215257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.216176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.217793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.233157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1089/2194] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:13.237053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.247586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebfc00-ce0b-4ece-9d12-3141de79441c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.255975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.256923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.257375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.257742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] PATH_INFO: `/v3/projects/8920d187f7a64f4595b6ad4d5531255f/users/90362dff2ecf4e189d50c57dbdbc34b2/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.274850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920d187f7a64f4595b6ad4d5531255f, user_id=90362dff2ecf4e189d50c57dbdbc34b2, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.277551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.366198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.368925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:13.370682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1106/2195] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:13 2022] PUT /identity/v3/projects/8920d187f7a64f4595b6ad4d5531255f/users/90362dff2ecf4e189d50c57dbdbc34b2/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:13.375779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.402828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632072f7-48f9-4545-bf34-86e379bf6644 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.446201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbe454-ccf2-4d58-b219-1ea3df6a2002 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.451540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.452211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.452499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.452788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.455106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.456955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.470609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1107/2196] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:13.473690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.484862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908010c-6136-4e44-98f2-78913fbdc6f8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.490082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.490974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.491263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.491592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] PATH_INFO: `/v3/projects/8920d187f7a64f4595b6ad4d5531255f/users/90362dff2ecf4e189d50c57dbdbc34b2/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.497486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920d187f7a64f4595b6ad4d5531255f, user_id=90362dff2ecf4e189d50c57dbdbc34b2, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.497486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95741d-4491-4b73-aa9b-bb5c4800022b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.512190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1108/2197] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:13 2022] PUT /identity/v3/projects/8920d187f7a64f4595b6ad4d5531255f/users/90362dff2ecf4e189d50c57dbdbc34b2/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:13.545703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.546960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.547442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.548767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] PATH_INFO: `/v3/projects/4473b296920a4c03977effcf598b8f05` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.551597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4473b296920a4c03977effcf598b8f05)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.556123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:13.680355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4473b296920a4c03977effcf598b8f05', 'request_id': 'req-77071cf4-00bb-4822-aaa6-5ef3dd47e806'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:13.760699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4473b296920a4c03977effcf598b8f05', 'request_id': 'req-77071cf4-00bb-4822-aaa6-5ef3dd47e806'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:13.768313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4473b296920a4c03977effcf598b8f05', 'request_id': 'req-77071cf4-00bb-4822-aaa6-5ef3dd47e806'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:13.778591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] The token cache is being invalidate because project 4473b296920a4c03977effcf598b8f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:13.778887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:13.779596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77071cf4-00bb-4822-aaa6-5ef3dd47e806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:13.781551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1090/2198] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:13 2022] DELETE /identity/v3/projects/4473b296920a4c03977effcf598b8f05 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:13.787050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.787689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.787969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.810386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:13.811782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:13.904932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1109/2199] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:13.912981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.913279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.913569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.935919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:13.935919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:13.949767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:13.956269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1091/2200] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:13.960523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121f72-b5c6-442e-90bf-5b55c55aeb02 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:13.965517 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:13.966987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:13.967340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:13.967723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:13.978493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:05:13.978493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:13.978493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.009490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1110/2201] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:05:14.013863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.031511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2191-cbf1-4b65-8e6f-de7f490e2b46 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.031511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.032349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.032747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.033255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.034055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.036701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.125439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1092/2202] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:14 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:14.132809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.145173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375eb5-6555-4011-9f0e-0f14852ff464 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.240083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.240817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.241099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.241372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.242083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.244310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.355497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1111/2203] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:14 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:14.359072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.368081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42153c9d-8943-4f00-ad6b-948ba5490a23 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.372884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.374024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.374314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.374590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.375351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.377203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.388082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1093/2204] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:14.392232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.403612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c753-f0ea-460a-b0d4-5c86bf26ede6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.408801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.409950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.409950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.410091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.411516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.413448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05ab8-fc80-4a03-94ba-d8c0bfe82e0e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.424613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1112/2205] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:14.435389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.445775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa758-2062-406f-a325-6da2463446f8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.450612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.452139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.452523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.453213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] PATH_INFO: `/v3/projects/bc69fb50e6564ecfa3784409e670cecd/users/ca0f760ce0e845a4833deede7752e08d/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.476037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc69fb50e6564ecfa3784409e670cecd, user_id=ca0f760ce0e845a4833deede7752e08d, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.479260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.584392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1094/2206] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:14 2022] PUT /identity/v3/projects/bc69fb50e6564ecfa3784409e670cecd/users/ca0f760ce0e845a4833deede7752e08d/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:14.594514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.594803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.595263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.637566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] MFA Rules not processed for user `ca0f760ce0e845a4833deede7752e08d`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:14.639349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:14.724755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1113/2207] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:14.738382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.741542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:14.819322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ddff-204e-4a73-b8aa-4676a7c9bba4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.825233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.826015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.826548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.827158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.847504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.849307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86551a70-50b0-4c08-a7a5-3abf6e2641d6 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:14.864451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1095/2208] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:14.887891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:14.973501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3591a2-c4d4-4068-96d1-53be8c323ef0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:14.980879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:14.982142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:14.982551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:14.982897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] PATH_INFO: `/v3/users/ca0f760ce0e845a4833deede7752e08d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:14.984259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0f760ce0e845a4833deede7752e08d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:14.987903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:15.231277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0f760ce0e845a4833deede7752e08d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:15.232300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0f760ce0e845a4833deede7752e08d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:15.232988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0f760ce0e845a4833deede7752e08d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:15.304506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0f760ce0e845a4833deede7752e08d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:15.325001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0f760ce0e845a4833deede7752e08d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:15.347573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1114/2209] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:14 2022] DELETE /identity/v3/users/ca0f760ce0e845a4833deede7752e08d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:15.350054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:15.350416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:15.350853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:15.370980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:15.372927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:15.461752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1096/2210] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:15.469200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:15.470791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:15.559338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1d9ec-43a1-4248-ab7c-5868d6a5579d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:15.569958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:15.571438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:15.571828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:15.572545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:15.585285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:15.587449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a980aa-6bf3-4c39-afba-36dc07098a84 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:15.598996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1115/2211] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:05:16.238673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:16.240687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:16.262777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba022c0-f1b4-485f-8c61-fc517f2550ea None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:16.267762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:16.268627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:16.268949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:16.269280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] PATH_INFO: `/v3/projects/bc69fb50e6564ecfa3784409e670cecd` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:16.271024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc69fb50e6564ecfa3784409e670cecd)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:16.273313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:16.557462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc69fb50e6564ecfa3784409e670cecd', 'request_id': 'req-d2523646-2790-410f-90fd-87270ee538c3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:16.897877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc69fb50e6564ecfa3784409e670cecd', 'request_id': 'req-d2523646-2790-410f-90fd-87270ee538c3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:16.907660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc69fb50e6564ecfa3784409e670cecd', 'request_id': 'req-d2523646-2790-410f-90fd-87270ee538c3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:16.922222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] The token cache is being invalidate because project bc69fb50e6564ecfa3784409e670cecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:16.927844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:16.927844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d2523646-2790-410f-90fd-87270ee538c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:16.927844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1097/2212] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:16 2022] DELETE /identity/v3/projects/bc69fb50e6564ecfa3784409e670cecd => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:16.931653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:16.932184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:16.932392 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:16.968683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:16.970005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:17.088047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1116/2213] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:17.097389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.097902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.098728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.132542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:17.134045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:17.153346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1098/2214] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:17.159311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.197335 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eacf6f-b67c-408a-8bf8-ac07f297376f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.204779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.205924 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.207410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.207943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.209115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:05:17.209900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.216601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.250999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1117/2215] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:05:17.251696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.270585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa353-87d6-44dd-a6d5-9e6d1ee88dc4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.292345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.294132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.296415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.298448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.305494 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.315366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.412749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1099/2216] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:17 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:17.414884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.432627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb88-e29e-4e92-a371-843ed9058bca admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.550926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.552643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.553007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.553354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.554297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.557541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.675694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1118/2217] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:17 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:05:17.676791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.699191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7271e87-1d93-4b5c-9a8f-5541f110974b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.709325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.715459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.715912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.716314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.717262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.719991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.736534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1100/2218] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:17.737816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.749680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe73b0-fa7e-4f0e-a132-de83a19f80f5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.755081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.760901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.760901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.760901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.760901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.760901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad41b-928e-4db0-9871-289a87e29677 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.769421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1119/2219] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:17.774201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:17.786942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2190fc-ad70-4db4-b777-5ecb0e08b157 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:17.792409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:17.793480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.793851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.794139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] PATH_INFO: `/v3/projects/3cb76f2913fa49baa991c10a8ad51772/users/8084efbfdb51411caa5df41c246ea663/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.810148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb76f2913fa49baa991c10a8ad51772, user_id=8084efbfdb51411caa5df41c246ea663, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:17.813174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:17.913210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1101/2220] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:17 2022] PUT /identity/v3/projects/3cb76f2913fa49baa991c10a8ad51772/users/8084efbfdb51411caa5df41c246ea663/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:17.923726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6536e-861c-466c-acec-df75842b05b2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:17.924860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6536e-861c-466c-acec-df75842b05b2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:17.925474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6536e-861c-466c-acec-df75842b05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:17.964383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-49e6536e-861c-466c-acec-df75842b05b2 None None] MFA Rules not processed for user `8084efbfdb51411caa5df41c246ea663`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:17.966807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-49e6536e-861c-466c-acec-df75842b05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:18.087640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1120/2221] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:18.095767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:18.097988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:18.205736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf61-1957-452a-8fe5-9df592f3035b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:18.210665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:18.211713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:18.212239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:18.212737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:18.226187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:18.227933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:18.262861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1102/2222] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:22.607645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eddc80-dfd6-4f8e-9e26-64aab5e2fe8c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:22.608117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eddc80-dfd6-4f8e-9e26-64aab5e2fe8c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:22.608317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eddc80-dfd6-4f8e-9e26-64aab5e2fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:22.634942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e1eddc80-dfd6-4f8e-9e26-64aab5e2fe8c None None] MFA Rules not processed for user `90362dff2ecf4e189d50c57dbdbc34b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:22.636195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e1eddc80-dfd6-4f8e-9e26-64aab5e2fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:22.709826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1121/2223] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:22.721875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:22.723908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:22.796311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e37eb8-1dbf-43cf-ab18-59097c898942 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:22.802609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:22.803259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:22.803577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:22.803920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:22.805638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:22.862358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:22.864114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686fb96-ccae-4440-88cc-e55c587d2b2d service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:22.873988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1103/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:25.866603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:25.867141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:25.867222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:25.888228 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] MFA Rules not processed for user `de83af66daf44bbc8fe7b916187e22cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:25.889713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:25.899763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1122/2225] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:29.805113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46287-c006-4880-991d-d01c540f37bf None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:29.805856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46287-c006-4880-991d-d01c540f37bf None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:29.805856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad46287-c006-4880-991d-d01c540f37bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:29.836365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bad46287-c006-4880-991d-d01c540f37bf None None] MFA Rules not processed for user `73c4353695e24961856ad4b8ec9fb20b`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:29.838228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bad46287-c006-4880-991d-d01c540f37bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:29.924078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1104/2226] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:30.286052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:30.288273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:30.461342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79190f66-fd3e-4f90-aecf-ab5ca32aaebb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:30.467104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:30.468117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:30.468533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:30.469039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] PATH_INFO: `/v3/users/51d34a1466f54010a4f4b10f10894996` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:30.470720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d34a1466f54010a4f4b10f10894996)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:30.473793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:30.712125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d34a1466f54010a4f4b10f10894996'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:30.713227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d34a1466f54010a4f4b10f10894996'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:30.713921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d34a1466f54010a4f4b10f10894996'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:30.765313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d34a1466f54010a4f4b10f10894996'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:30.784574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d34a1466f54010a4f4b10f10894996'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:30.802478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1123/2227] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:05:30 2022] DELETE /identity/v3/users/51d34a1466f54010a4f4b10f10894996 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:30.804686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:30.805082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:30.805461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:30.834440 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:30.835833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:30.916122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1105/2228] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:05:30.935888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:30.939059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:31.057755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3656a-df43-4f01-ae39-e3bd7f42185a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:31.061565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:31.062308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:31.062689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:31.063079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:31.075372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:31.077011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49461dd1-bc89-4832-be12-6f3154fefb39 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:31.089062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1124/2229] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:31.688604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:31.690185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:31.702233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4a4c6-ccdf-4f08-bd37-03bcda36634a None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:31.714135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:31.715009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:31.715292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:31.715774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] PATH_INFO: `/v3/projects/fb72b8a8163341ddbb4d2e26e7bdf79e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:31.716973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb72b8a8163341ddbb4d2e26e7bdf79e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:31.718917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:31.862683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb72b8a8163341ddbb4d2e26e7bdf79e', 'request_id': 'req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:31.925817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb72b8a8163341ddbb4d2e26e7bdf79e', 'request_id': 'req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:31.932421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb72b8a8163341ddbb4d2e26e7bdf79e', 'request_id': 'req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:31.943604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] The token cache is being invalidate because project fb72b8a8163341ddbb4d2e26e7bdf79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:05:31.943899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:31.944663 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-f9f96ce2-db9e-47fb-a81a-c3cd610fa3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:05:31.949353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1106/2230] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:05:31 2022] DELETE /identity/v3/projects/fb72b8a8163341ddbb4d2e26e7bdf79e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:05:31.950987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:31.951457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:31.951578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:31.979331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:31.980595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:32.041691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1125/2231] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:32.051148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.051551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.051912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.071640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:32.072993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:32.081462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1107/2232] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:32.086383 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.097278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb2677-2fd1-4896-8dfc-6440dd9fcf88 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.102206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.102862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.103147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.103453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.104245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:05:32.104556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.106163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.122381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1126/2233] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:05:32.123649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.133455 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850ff40-1093-4ba4-90c3-56cdac0894a2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.139307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.139995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.140280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.140555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.141250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.143174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.274206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1108/2234] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:05:32 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:05:32.275343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.286152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a91bc-48b1-4605-bb28-35a09cc4846e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.345478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.346334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.346557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.346693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.347404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.349477 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.420079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1127/2235] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:05:32 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:05:32.424407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.437277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15114509-9236-4158-b649-db31e6e7777f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.445021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.445874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.446231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.446579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.447459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.449324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.465501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1109/2236] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:05:32.467741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.482140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8168a-30e5-46b7-a949-52738272fc27 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.491033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.491733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.492109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.492389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.493154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.494778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae653-f415-4e7b-83c8-e2bdaf841091 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.506129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1128/2237] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:05:32.510371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.521070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e6d4-8375-44f2-92bb-e07e707adada admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.526128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.527060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.527385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.527709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] PATH_INFO: `/v3/projects/640c9f5539614165bff049a99e1957d2/users/3fc372ea5a9e488692c91cb5a75fe219/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.542866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c9f5539614165bff049a99e1957d2, user_id=3fc372ea5a9e488692c91cb5a75fe219, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.545572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.618167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1110/2238] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:05:32 2022] PUT /identity/v3/projects/640c9f5539614165bff049a99e1957d2/users/3fc372ea5a9e488692c91cb5a75fe219/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:05:32.623090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68b57-fc65-470f-9a48-9cc64b90d368 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.623410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68b57-fc65-470f-9a48-9cc64b90d368 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.623758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc68b57-fc65-470f-9a48-9cc64b90d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.642444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5dc68b57-fc65-470f-9a48-9cc64b90d368 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:32.643687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5dc68b57-fc65-470f-9a48-9cc64b90d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:32.704136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1129/2239] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:32.713725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:32.715699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:32.770854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa081-c627-4c02-abd9-162961de1f8d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:32.774467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:32.775106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:32.775389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:32.775699 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:32.784463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:32.786382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:32.795582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1111/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:33.971172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1056988-03d5-4e2a-8b8a-8f1ba7b86ea0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:33.971758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1056988-03d5-4e2a-8b8a-8f1ba7b86ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:33.972114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1056988-03d5-4e2a-8b8a-8f1ba7b86ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:34.005062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a1056988-03d5-4e2a-8b8a-8f1ba7b86ea0 None None] MFA Rules not processed for user `3fc372ea5a9e488692c91cb5a75fe219`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:34.006336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a1056988-03d5-4e2a-8b8a-8f1ba7b86ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:34.082371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1130/2241] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:34.093031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:34.094461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:34.150946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07548d04-cecc-46e9-b3dc-e004fa3d93af service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:34.154724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:34.155373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:34.155692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:34.155982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:34.165118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:34.166577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe654e5-ef97-4bcd-8bf7-bbebbacc7826 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:34.176654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1112/2242] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:05:36.106265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656694-2705-4682-9226-22648cdab84b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:36.106928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656694-2705-4682-9226-22648cdab84b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:36.108879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656694-2705-4682-9226-22648cdab84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:36.134493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9f656694-2705-4682-9226-22648cdab84b None None] MFA Rules not processed for user `3fc372ea5a9e488692c91cb5a75fe219`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:36.138821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9f656694-2705-4682-9226-22648cdab84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:36.143570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1131/2243] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:49.650805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab873403-8a65-44d4-80e4-5800ce6c287e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:49.651269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab873403-8a65-44d4-80e4-5800ce6c287e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:49.651495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab873403-8a65-44d4-80e4-5800ce6c287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:49.688970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ab873403-8a65-44d4-80e4-5800ce6c287e None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:05:49.690179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ab873403-8a65-44d4-80e4-5800ce6c287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:49.762148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1113/2244] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:05:49.808910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656694-2705-4682-9226-22648cdab84b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:05:49.810582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9f656694-2705-4682-9226-22648cdab84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:05:49.888351 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656694-2705-4682-9226-22648cdab84b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:05:49.893742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:05:49.894420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:05:49.894703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:05:49.895557 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:05:49.904462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:05:49.906038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:05:49.919610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1132/2245] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:05:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:06:05.992881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2e6f5-204d-40e5-ad11-e1611254d053 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:05.994245 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2e6f5-204d-40e5-ad11-e1611254d053 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:05.994636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2e6f5-204d-40e5-ad11-e1611254d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:06.014919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a6f2e6f5-204d-40e5-ad11-e1611254d053 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:06.016415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a6f2e6f5-204d-40e5-ad11-e1611254d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:06.032557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1114/2246] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:06.046692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:06.059223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1d8a-8296-4321-88ec-fd1c49465a91 service swift] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:06.064807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:06.065454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:06.065744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:06.066027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:06.075128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:06.076761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5b5d8-7e10-416c-8cf9-364232342253 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:06.085986 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1133/2247] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:06:11.804662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:11.805349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:11.805349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:11.807100 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1115/2248] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:06:11.819347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:11.820007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:11.820210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:11.984300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:11.986201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:12.160054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1134/2249] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:18.357620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:18.362653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:18.474805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4391-e4b2-4f7d-8991-32e78ab3f485 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:18.479996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:18.480639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:18.480928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:18.481206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:18.483037 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:18.494788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:18.496416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:18.506888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1116/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:06:24.055960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:24.057791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:24.084750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd726fd3-f00a-404d-9a7b-d14042de153b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:24.090268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:24.091100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:24.091530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:24.091900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:24.095494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:24.241430 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:24.242806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18809a76-1d5d-4d45-b545-1daa5dcca76b service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:24.301441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1135/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:06:24.397597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:24.399241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:24.509282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a50b0b-d02c-40b0-8340-16b5cddd4fe6 service placement] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:24.513224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:24.514563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:24.515091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:24.515633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:24.529566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:24.531627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa3ae-eb32-4386-82e9-c1561be9de6e service glance] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:24.545545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1117/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:06:24.783438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7bda-fe56-4bdb-923c-52c37b5592e5 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:24.784085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7bda-fe56-4bdb-923c-52c37b5592e5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:24.787622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7bda-fe56-4bdb-923c-52c37b5592e5 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:24.787622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1136/2253] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:06:24.793204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d50b6-78f6-45bf-a415-46cd704b6a0c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:24.793695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d50b6-78f6-45bf-a415-46cd704b6a0c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:24.794146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d50b6-78f6-45bf-a415-46cd704b6a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:24.822565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4a4d50b6-78f6-45bf-a415-46cd704b6a0c None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:24.825096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4a4d50b6-78f6-45bf-a415-46cd704b6a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:24.836427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1118/2254] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:24.855666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7bda-fe56-4bdb-923c-52c37b5592e5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:24.871119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7bda-fe56-4bdb-923c-52c37b5592e5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:24.877153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:24.877920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:24.878303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:24.878592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:24.889590 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:24.891058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aff0-8de1-4b9b-8238-954d3f1b7a33 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:24.903781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1137/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:06:25.031270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656c32-be93-40e4-8980-941536421941 None None] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:25.031865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656c32-be93-40e4-8980-941536421941 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:25.032946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656c32-be93-40e4-8980-941536421941 None None] PATH_INFO: `/` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:25.035132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1119/2256] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:06:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 13:06:25.077705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac228-d392-4e91-a427-53c6626c0cf9 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:25.083038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac228-d392-4e91-a427-53c6626c0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:25.083715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac228-d392-4e91-a427-53c6626c0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:25.149194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-baaac228-d392-4e91-a427-53c6626c0cf9 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:25.156854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-baaac228-d392-4e91-a427-53c6626c0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:25.199635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1138/2257] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:06:25.205426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656c32-be93-40e4-8980-941536421941 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:25.221425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656c32-be93-40e4-8980-941536421941 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:25.231515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:25.232349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:25.232639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:25.233102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:25.245802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:25.247551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:25.262086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1120/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:06:30.266657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc3a5-39b9-47cd-b6af-24da35a6bb60 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:30.267698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc3a5-39b9-47cd-b6af-24da35a6bb60 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:30.268187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc3a5-39b9-47cd-b6af-24da35a6bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:30.323874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-57dfc3a5-39b9-47cd-b6af-24da35a6bb60 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:30.325137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-57dfc3a5-39b9-47cd-b6af-24da35a6bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:30.347811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1139/2259] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:06:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:30.360633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:30.384133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a56674-609c-4ebd-8961-fb2854845000 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:30.390798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:30.391485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:30.392000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:30.392287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:30.401399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:30.403900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:30.414622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1121/2260] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:06:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:06:36.094653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:36.099575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:36.099575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:36.117775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:36.119069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:36.135582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1140/2261] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:06:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:36.146236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:36.157373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75599-98eb-4fd1-8cd7-1258e44f6692 service swift] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:36.165809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:36.166874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:36.167497 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:36.167789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:36.187086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:36.190305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1265c-3039-4416-879c-4bf48c6449c3 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:36.199515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1122/2262] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:06:38.839012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:38.841377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:38.883718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7029b-c3b6-4a4e-9d76-e2cdfedc497b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:38.895967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:38.897297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:38.898317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:38.898801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] PATH_INFO: `/v3/users/8084efbfdb51411caa5df41c246ea663` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:38.900359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8084efbfdb51411caa5df41c246ea663)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:38.902636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:39.119943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8084efbfdb51411caa5df41c246ea663'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:39.120960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8084efbfdb51411caa5df41c246ea663'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:39.121923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8084efbfdb51411caa5df41c246ea663'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:39.228024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8084efbfdb51411caa5df41c246ea663'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:39.248063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8084efbfdb51411caa5df41c246ea663'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:39.270919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1141/2263] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:06:38 2022] DELETE /identity/v3/users/8084efbfdb51411caa5df41c246ea663 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:39.272387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:39.272818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:39.272980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:39.305049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:39.306363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:39.393028 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1123/2264] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:39.403627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:39.405181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:39.506281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de65e8-2b35-4d1e-906a-4e2eb6a83146 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:39.510639 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:39.511305 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:39.511879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:39.512166 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:39.528406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:39.529985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:39.540638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1142/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:06:40.421365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:40.422873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:40.465506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174db15d-5f45-4995-95f3-79d5bfd7d4c2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:40.481139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:40.482126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:40.482515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:40.482915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] PATH_INFO: `/v3/projects/3cb76f2913fa49baa991c10a8ad51772` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:40.486249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb76f2913fa49baa991c10a8ad51772)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:40.488205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:40.681274 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb76f2913fa49baa991c10a8ad51772', 'request_id': 'req-dca38862-b8f3-4c49-a1e8-fd401c90ab15'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:40.758115 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb76f2913fa49baa991c10a8ad51772', 'request_id': 'req-dca38862-b8f3-4c49-a1e8-fd401c90ab15'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:40.764298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb76f2913fa49baa991c10a8ad51772', 'request_id': 'req-dca38862-b8f3-4c49-a1e8-fd401c90ab15'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:40.776297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] The token cache is being invalidate because project 3cb76f2913fa49baa991c10a8ad51772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:06:40.776594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:40.777307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:40.778858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1124/2266] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:06:40 2022] DELETE /identity/v3/projects/3cb76f2913fa49baa991c10a8ad51772 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:41.021842 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:41.023998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:41.036647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3c1c-5977-4fa8-949e-1e46ed5a0357 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:41.089705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:41.090550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:41.090829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:41.091100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] PATH_INFO: `/v3/users/73c4353695e24961856ad4b8ec9fb20b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:41.092286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c4353695e24961856ad4b8ec9fb20b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:41.094190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:41.262953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c4353695e24961856ad4b8ec9fb20b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.263663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c4353695e24961856ad4b8ec9fb20b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.264265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c4353695e24961856ad4b8ec9fb20b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.347313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c4353695e24961856ad4b8ec9fb20b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.359695 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f22eeac6-5b7f-4860-91c0-ce13c3186a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c4353695e24961856ad4b8ec9fb20b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.378193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1143/2267] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:06:41 2022] DELETE /identity/v3/users/73c4353695e24961856ad4b8ec9fb20b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:41.629474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:41.630978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:41.649583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca38862-b8f3-4c49-a1e8-fd401c90ab15 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:41.715576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:41.716547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:41.716903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:41.717250 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] PATH_INFO: `/v3/projects/b2f73b1e0a1347a8904c662844ebd9d3` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:41.718528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f73b1e0a1347a8904c662844ebd9d3)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:41.720566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:41.867680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f73b1e0a1347a8904c662844ebd9d3', 'request_id': 'req-3b54c10a-245a-4b71-b002-aaf6ebb43037'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.963956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f73b1e0a1347a8904c662844ebd9d3', 'request_id': 'req-3b54c10a-245a-4b71-b002-aaf6ebb43037'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.969963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f73b1e0a1347a8904c662844ebd9d3', 'request_id': 'req-3b54c10a-245a-4b71-b002-aaf6ebb43037'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.981229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] The token cache is being invalidate because project b2f73b1e0a1347a8904c662844ebd9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:06:41.981523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.982168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3b54c10a-245a-4b71-b002-aaf6ebb43037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:41.983752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1125/2268] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:06:41 2022] DELETE /identity/v3/projects/b2f73b1e0a1347a8904c662844ebd9d3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:41.989046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:41.989338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:41.989615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.017852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:42.019050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:42.088442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1144/2269] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:42.096702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.097091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.097379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.116303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:42.126948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:42.126948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1126/2270] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:42.129835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.139436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b6f5-b9a3-4e09-b2f8-b160ee95bce5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.144043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.144693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.144979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.145256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.145984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:06:42.146291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.148474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.160043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1145/2271] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:06:42.165195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.175204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d443-1126-4ddb-910a-fd5bd68b6698 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.180194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.180891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.181752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.182053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.182991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.184966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.321045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1127/2272] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:06:42 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:42.325146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.334966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc711-2bfe-491d-a753-c3f73f087718 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.389474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.390073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.390363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.390641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.391357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.393390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.467155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1146/2273] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:06:42 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:42.471052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.481588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a75310-ce80-4911-bbf2-3dd1cede8fb8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.486182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.486824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.487105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.487381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.488198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.489815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.500329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1128/2274] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:06:42.504194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.513907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79bde4-d8c7-4a88-b854-ed11c5e848dd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.518433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.519069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.519350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.519730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.520441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.522015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df828-5b19-45f7-8fdd-c12a19ce1c75 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.531722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1147/2275] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:06:42.535447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.545582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3787b-c660-4ab2-a616-fffa3a86e4a8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.550452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.551314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.551737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.552022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] PATH_INFO: `/v3/projects/a2c7bd5739fd4cebbacda0fd2a61e86d/users/98eed89d146f475aa945966ce3f1607f/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.566603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c7bd5739fd4cebbacda0fd2a61e86d, user_id=98eed89d146f475aa945966ce3f1607f, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.569634 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.634588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1129/2276] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:06:42 2022] PUT /identity/v3/projects/a2c7bd5739fd4cebbacda0fd2a61e86d/users/98eed89d146f475aa945966ce3f1607f/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:42.645372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.645839 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.646134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.673690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] MFA Rules not processed for user `98eed89d146f475aa945966ce3f1607f`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:42.674892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:42.737338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1148/2277] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:42.748578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:42.750307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:42.841233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f49c4-9a25-4203-883d-ce1b958e1da4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:42.845152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:42.845935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:42.846506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:42.846801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:42.856939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:42.858434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:42.867815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1130/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:06:43.782408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:43.783900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:43.847562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119815-a5e9-47ff-a851-29fd7503bfc8 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:43.852448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:43.853387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:43.853780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:43.854068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] PATH_INFO: `/v3/users/69b4c5f51c5943ef95fd751c67d2e901` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:43.855296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b4c5f51c5943ef95fd751c67d2e901)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:43.857311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:44.058951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b4c5f51c5943ef95fd751c67d2e901'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.059643 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b4c5f51c5943ef95fd751c67d2e901'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.060267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b4c5f51c5943ef95fd751c67d2e901'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.107760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b4c5f51c5943ef95fd751c67d2e901'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.120918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b1841837-4ffc-4a4d-9fb9-bccbb13ed865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b4c5f51c5943ef95fd751c67d2e901'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.143944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1149/2279] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:06:43 2022] DELETE /identity/v3/users/69b4c5f51c5943ef95fd751c67d2e901 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:44.383223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:44.399287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41d37-7079-4caa-9748-f506938249cc service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:44.454275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:44.455138 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:44.455429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:44.455746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] PATH_INFO: `/v3/projects/a514bc8f2c964d85b7aa365400763653` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:44.456936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a514bc8f2c964d85b7aa365400763653)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:44.458913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:44.580047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a514bc8f2c964d85b7aa365400763653', 'request_id': 'req-e617547a-4004-4292-97cb-b9b86d3e6613'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.650329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a514bc8f2c964d85b7aa365400763653', 'request_id': 'req-e617547a-4004-4292-97cb-b9b86d3e6613'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.656392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a514bc8f2c964d85b7aa365400763653', 'request_id': 'req-e617547a-4004-4292-97cb-b9b86d3e6613'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.668076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] The token cache is being invalidate because project a514bc8f2c964d85b7aa365400763653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:06:44.668363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.669024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e617547a-4004-4292-97cb-b9b86d3e6613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:44.670703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1131/2280] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:06:44 2022] DELETE /identity/v3/projects/a514bc8f2c964d85b7aa365400763653 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:44.675685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:44.675896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:44.676179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:44.694985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:44.698080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:44.754646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1150/2281] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:44.762977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:44.763399 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:44.763775 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:44.783169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:44.784431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:44.792458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1132/2282] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:44.796745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:44.806622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883cf7-f395-4ea5-bd0a-b7cd317cff2f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:44.811296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:44.811979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:44.812267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:44.812547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:44.813262 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:06:44.813572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:44.815167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:44.827120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1151/2283] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:06:44.831554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:44.841293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05feed-f84f-40d5-ac6f-90438274095f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:44.846014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:44.846676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:44.846948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:44.847229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:44.847973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:44.849962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:44.966696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1133/2284] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:06:44 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:44.970915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:44.981038 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fc72c-147a-4916-a964-9fd12842054f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:45.036871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:45.037521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.037849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.038127 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.038833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:45.040763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:45.118826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1152/2285] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:06:44 2022] POST /identity/v3/users => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:45.122916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:45.133665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89134f3f-7f23-4111-a59a-e2a93d01a980 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:45.138212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:45.138862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.139143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.139416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.140162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:45.141762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:45.151837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1134/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:06:45.155599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:45.165489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf43fbf-614d-4dbc-91a8-4fe56b231708 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:45.174926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:45.174926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.174926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.174926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.175341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:45.175341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b155ff-dff8-4e45-954f-a6263efbc3c9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:45.184810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1153/2287] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:06:45.188893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:45.199724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb993d5-e5d2-4e95-9a3a-df2c962a6a10 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:45.204398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:45.205467 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.205638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.205918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] PATH_INFO: `/v3/projects/3faaebd56c80405daeb94427753fdac2/users/d701df6ec7aa42d891b6574702c11c8a/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.231817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faaebd56c80405daeb94427753fdac2, user_id=d701df6ec7aa42d891b6574702c11c8a, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:45.234586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:45.333020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1135/2288] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:06:45 2022] PUT /identity/v3/projects/3faaebd56c80405daeb94427753fdac2/users/d701df6ec7aa42d891b6574702c11c8a/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:45.334237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd46c-cede-4c06-b9ae-2cdd6b40e9b6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.334801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd46c-cede-4c06-b9ae-2cdd6b40e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.335084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd46c-cede-4c06-b9ae-2cdd6b40e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.354337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f62fd46c-cede-4c06-b9ae-2cdd6b40e9b6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:45.355565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f62fd46c-cede-4c06-b9ae-2cdd6b40e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:45.416177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1154/2289] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:45.426106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:45.428027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:45.485949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf76912-204d-478a-b4b5-458cd91f7c7c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:45.491646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:45.491646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:45.491646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:45.491913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:45.500858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:45.502290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:45.512292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1136/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:06:46.839743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:46.840307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:46.840647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:46.870159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] MFA Rules not processed for user `d701df6ec7aa42d891b6574702c11c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:46.871597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:46.938021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1155/2291] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:06:46.943863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:46.953591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e550f90-304a-4a2b-b3db-bde8f43b3d81 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:46.958226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:46.958870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:46.959154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:46.959431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:46.960215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:46.962130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.042002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1137/2292] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:06:46 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:06:47.046058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:47.058121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381a10c-ad07-4cdc-afa1-e9fde1366f45 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:47.118043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:47.118810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:47.119174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:47.119559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:47.120331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:47.122386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.192934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1156/2293] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:06:47 2022] POST /identity/v3/users => generated 308 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:06:47.196907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:47.212369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0568-b714-4983-b3d3-99d80332d802 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:47.212369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:47.212369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:47.212369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:47.212762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:47.213297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:47.214926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.225161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1138/2294] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:06:47.229634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:47.239861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054b05-8b5f-4412-bd77-cfacd77db6e3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:47.245020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:47.245883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:47.246466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:47.246466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] PATH_INFO: `/v3/projects/1d904bf82f4b44539673fb56aa2ad594/users/b35a1b44356d4329b435091496ecda3b/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:47.260767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d904bf82f4b44539673fb56aa2ad594, user_id=b35a1b44356d4329b435091496ecda3b, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:47.263444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.336544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1157/2295] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:06:47 2022] PUT /identity/v3/projects/1d904bf82f4b44539673fb56aa2ad594/users/b35a1b44356d4329b435091496ecda3b/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:47.340484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:47.352745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e765c-c7ed-4634-a1eb-952c39f1e3a1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:47.409714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:47.410282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:47.410566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:47.410842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:47.411855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:47.414244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d653bcd-6132-4c26-bad9-6c0059746293 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.424087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1139/2296] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:06:47.428242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:47.438450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e740b-afe8-4ab4-8b6b-ce32cf8002a6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:47.443016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:47.443933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:47.444260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:47.444533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] PATH_INFO: `/v3/projects/1d904bf82f4b44539673fb56aa2ad594/users/b35a1b44356d4329b435091496ecda3b/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:47.446441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d904bf82f4b44539673fb56aa2ad594, user_id=b35a1b44356d4329b435091496ecda3b, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:47.449126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:47.458910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1158/2297] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:06:47 2022] PUT /identity/v3/projects/1d904bf82f4b44539673fb56aa2ad594/users/b35a1b44356d4329b435091496ecda3b/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:48.680381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:48.681217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:48.681496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:48.713942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] MFA Rules not processed for user `b35a1b44356d4329b435091496ecda3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:48.715678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:48.801219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1140/2298] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:50.335789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:50.414446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fbb8c-0e53-4721-a7d2-6d8923c943c9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:50.419503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:50.420408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:50.420699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:50.420985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] PATH_INFO: `/v3/users/d701df6ec7aa42d891b6574702c11c8a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:50.422260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d701df6ec7aa42d891b6574702c11c8a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:50.424604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:50.584553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd701df6ec7aa42d891b6574702c11c8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:50.585242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd701df6ec7aa42d891b6574702c11c8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:50.585850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd701df6ec7aa42d891b6574702c11c8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:50.655786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd701df6ec7aa42d891b6574702c11c8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:50.668902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd701df6ec7aa42d891b6574702c11c8a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:50.681870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1159/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:06:50 2022] DELETE /identity/v3/users/d701df6ec7aa42d891b6574702c11c8a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:06:50.908395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:50.919357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1c9c5-9ed4-411f-a94b-2cfb842016a4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:50.979794 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:50.980654 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:50.980939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:50.981221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] PATH_INFO: `/v3/projects/3faaebd56c80405daeb94427753fdac2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:50.982397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3faaebd56c80405daeb94427753fdac2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:50.984386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:51.074326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faaebd56c80405daeb94427753fdac2', 'request_id': 'req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.124381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faaebd56c80405daeb94427753fdac2', 'request_id': 'req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.130195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faaebd56c80405daeb94427753fdac2', 'request_id': 'req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.141166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] The token cache is being invalidate because project 3faaebd56c80405daeb94427753fdac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:06:51.141448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.142106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.143657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1141/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:06:50 2022] DELETE /identity/v3/projects/3faaebd56c80405daeb94427753fdac2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:51.153265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:51.154683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:51.168009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab0394-fdb2-4743-88fd-254d4b34c889 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:51.220912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:51.221771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:51.222052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:51.222325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] PATH_INFO: `/v3/users/b35a1b44356d4329b435091496ecda3b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:51.223554 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35a1b44356d4329b435091496ecda3b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:51.226083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:51.394400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35a1b44356d4329b435091496ecda3b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.395579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35a1b44356d4329b435091496ecda3b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.396294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35a1b44356d4329b435091496ecda3b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.472272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35a1b44356d4329b435091496ecda3b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.484157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4e26ed9b-7e48-43e9-a0c9-8f2e1efcae94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35a1b44356d4329b435091496ecda3b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.495656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1160/2301] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:06:51 2022] DELETE /identity/v3/users/b35a1b44356d4329b435091496ecda3b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:51.742918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:51.744396 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:51.757359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf52ac-6d71-42e9-a16e-d5f73ddc9524 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:51.813754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:51.814599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:51.814883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:51.815156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] PATH_INFO: `/v3/projects/1d904bf82f4b44539673fb56aa2ad594` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:51.816366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d904bf82f4b44539673fb56aa2ad594)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:51.818275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:51.889240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d904bf82f4b44539673fb56aa2ad594', 'request_id': 'req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.941179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d904bf82f4b44539673fb56aa2ad594', 'request_id': 'req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.947521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d904bf82f4b44539673fb56aa2ad594', 'request_id': 'req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.958565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] The token cache is being invalidate because project 1d904bf82f4b44539673fb56aa2ad594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:06:51.958855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.959514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1ca12359-5eea-4e0c-9d8a-feb46a5bfeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:06:51.961086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1142/2302] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:06:51 2022] DELETE /identity/v3/projects/1d904bf82f4b44539673fb56aa2ad594 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:51.967388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:51.967717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:51.968003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:51.986478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:51.987750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:52.045369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1161/2303] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:52.053964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.054252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.054533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.072738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:52.073947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:52.081989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1143/2304] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:52.086114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.095849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f302a-3667-497a-9538-8ad97237f6dd None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.100544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.101191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.101476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.101752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.102470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:06:52.102774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.104407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.116527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1162/2305] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:06:52.120442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.133196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae40fa-8dca-4e79-ba85-2abeeb733c18 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.138111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.138766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.139083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.139414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.140206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.142125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.252032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1144/2306] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:06:52 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:52.256106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.265749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d28b3-da8b-4b20-a747-c6c736a964c7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.320123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.320788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.321075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.321355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.322047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.324088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.502617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1163/2307] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:06:52 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:06:52.510171 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.520232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587147c8-c71c-4631-adc7-5871c30c640c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.525764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.526423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.526707 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.526985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.527763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.529419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.540577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1145/2308] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:06:52.544690 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.555191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1e46a-b225-4a63-bc69-e3e88131c43d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.560003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.560662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.560945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.561222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.562137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.563776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78d0c-32bb-458f-b683-ed6f8ae2b705 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.573911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1164/2309] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:06:52.583509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.593865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1da903-61c1-4b90-91d6-8a747307d78e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.598384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.599261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.599649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.599862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] PATH_INFO: `/v3/projects/4504503a5a854f8bbae75fb4b20acd8c/users/f40976fbb813488bb9d0ddc46d274933/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.614556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504503a5a854f8bbae75fb4b20acd8c, user_id=f40976fbb813488bb9d0ddc46d274933, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.617371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.684451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1146/2310] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:06:52 2022] PUT /identity/v3/projects/4504503a5a854f8bbae75fb4b20acd8c/users/f40976fbb813488bb9d0ddc46d274933/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:06:52.695919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28b73-ee59-4770-8ea0-e4023b9d6b04 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.696217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28b73-ee59-4770-8ea0-e4023b9d6b04 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.696504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28b73-ee59-4770-8ea0-e4023b9d6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.722588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f0a28b73-ee59-4770-8ea0-e4023b9d6b04 None None] MFA Rules not processed for user `f40976fbb813488bb9d0ddc46d274933`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:06:52.723826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f0a28b73-ee59-4770-8ea0-e4023b9d6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:52.784093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1165/2311] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:06:52.795515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:06:52.797200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:06:52.852644 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d19ea-43fe-47a8-ab7a-608c2f19310f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:06:52.856403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:06:52.857073 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:06:52.857388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:06:52.857671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:06:52.867257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:06:52.868730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:06:52.877452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1147/2312] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:08.032573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:08.033043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:08.035338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:08.051374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:08.052735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:08.107263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1166/2313] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:08.129751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:08.131148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:08.212408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b527d-7cfe-4c51-a7d1-6fa802ff7f57 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:08.217778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:08.218746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:08.219149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:08.219647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:08.229191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:08.230890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e970ae-c93e-4042-9f8a-5d7ce93a53b4 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:08.239282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1148/2314] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:07:09.251520 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:09.252953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:09.318321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ef2a3-863f-4975-bafe-8d1a22370c6f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:09.323950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:09.324809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:09.325793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:09.325793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] PATH_INFO: `/v3/users/98eed89d146f475aa945966ce3f1607f` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:09.326627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=98eed89d146f475aa945966ce3f1607f)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:09.328585 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:09.530881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98eed89d146f475aa945966ce3f1607f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:09.531579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98eed89d146f475aa945966ce3f1607f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:09.532208 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98eed89d146f475aa945966ce3f1607f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:09.633523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98eed89d146f475aa945966ce3f1607f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:09.645447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98eed89d146f475aa945966ce3f1607f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:09.658532 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1167/2315] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:09 2022] DELETE /identity/v3/users/98eed89d146f475aa945966ce3f1607f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:09.663188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:09.663718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:09.663838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:09.682181 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:09.683429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:09.740935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1149/2316] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:09.750926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:09.752641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:09.818290 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8d386-c6d7-4bc8-9df7-f69e944da6ff admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:09.822646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:09.823292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:09.823621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:09.823902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:09.833147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:09.834597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5660d9c-ef3e-4d51-8f50-ddbdb2a8a6b2 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:09.844488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1168/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:10.337309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:10.340600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:10.351127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf62493-1e7a-402e-8b84-dac7595e8f51 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:10.356862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:10.357730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.358017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.358297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] PATH_INFO: `/v3/projects/a2c7bd5739fd4cebbacda0fd2a61e86d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.360194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c7bd5739fd4cebbacda0fd2a61e86d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:10.362659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:10.453964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c7bd5739fd4cebbacda0fd2a61e86d', 'request_id': 'req-95178d6d-e6cf-4e55-82c6-48ce780f60f3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:10.540834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c7bd5739fd4cebbacda0fd2a61e86d', 'request_id': 'req-95178d6d-e6cf-4e55-82c6-48ce780f60f3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:10.546623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c7bd5739fd4cebbacda0fd2a61e86d', 'request_id': 'req-95178d6d-e6cf-4e55-82c6-48ce780f60f3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:10.557917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] The token cache is being invalidate because project a2c7bd5739fd4cebbacda0fd2a61e86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:10.558209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:10.558851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-95178d6d-e6cf-4e55-82c6-48ce780f60f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:10.560423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1150/2318] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:10 2022] DELETE /identity/v3/projects/a2c7bd5739fd4cebbacda0fd2a61e86d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:10.565605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.567155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.567155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.584580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:10.585860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:10.643765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1169/2319] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:07:10.652618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.652916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.653196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.671639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:10.673126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:10.681033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1151/2320] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:10.685112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:10.694521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148eeab-6e9b-4118-b186-5e0b6fcac723 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:10.699070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:10.701447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.701447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.701447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.701447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:10.701447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:10.702907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:10.714623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1170/2321] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:10.718724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:10.728433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073f18-6d0f-4d0e-8d54-74d52b7a510b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:10.733162 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:10.733810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.734095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.734376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.735081 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:10.737043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:10.840016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1152/2322] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:10 2022] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:07:10.844196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:10.854453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48221e28-46a9-462c-9a2b-bd7a016093b1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:10.908882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:10.909547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:10.909834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:10.910114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:10.910813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:10.912802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:11.097100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1171/2323] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:10 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:07:11.097847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:11.109713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f4ce2-d701-45be-83be-4f1aa7652089 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:11.115120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:11.115959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:11.116321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:11.116674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:11.117525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:11.119333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:11.130801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1153/2324] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:11.135414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:11.146069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fc571-273f-4718-ae68-81020cb9bf50 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:11.152397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:11.153069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:11.153352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:11.153626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:11.154358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:11.156048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692a71-a0ee-483f-a3ee-a6a033e3ce3a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:11.166781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1172/2325] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:11.170997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:11.181774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70369e-d1cd-4157-a906-c3276ab37419 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:11.187060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:11.188067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:11.188427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:11.188939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] PATH_INFO: `/v3/projects/4c8b471b707149398d1213a4a3574b98/users/7beceac9b1ce498a95484abed7305d27/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:11.205366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8b471b707149398d1213a4a3574b98, user_id=7beceac9b1ce498a95484abed7305d27, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:11.208621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:11.290316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1154/2326] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:11 2022] PUT /identity/v3/projects/4c8b471b707149398d1213a4a3574b98/users/7beceac9b1ce498a95484abed7305d27/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:11.300772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:11.301066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:11.301343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:11.330299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] MFA Rules not processed for user `7beceac9b1ce498a95484abed7305d27`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:11.331662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:11.395878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1173/2327] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:11.423260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:11.425128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:11.486233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79938dde-b1df-48f8-8250-df66d2749ddc admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:11.486233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:11.486233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:11.486680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:11.486680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:11.495693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:11.497149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd936-f3e3-4feb-a229-de1caada1643 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:11.506120 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1155/2328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:22.467558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:22.531609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c50f2-1c3a-478a-8716-40da63d9424d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:22.536137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:22.537020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:22.537316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:22.537574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] PATH_INFO: `/v3/users/7beceac9b1ce498a95484abed7305d27` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:22.538776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7beceac9b1ce498a95484abed7305d27)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:22.540746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:22.714943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7beceac9b1ce498a95484abed7305d27'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:22.715644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7beceac9b1ce498a95484abed7305d27'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:22.716315 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7beceac9b1ce498a95484abed7305d27'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:22.792587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7beceac9b1ce498a95484abed7305d27'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:22.806234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7beceac9b1ce498a95484abed7305d27'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:22.818809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1174/2329] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:22 2022] DELETE /identity/v3/users/7beceac9b1ce498a95484abed7305d27 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:22.826747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:22.827240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:22.827361 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:22.844176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:22.846576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:22.905604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1156/2330] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:22.915236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:22.925706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:22.975758 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6bcd-63c4-400e-a771-148a4f63a2b4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:22.979697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:22.980525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:22.981543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:22.982087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:22.993402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:22.995860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:23.007616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1175/2331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:23.399952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:23.401694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:23.414892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544c351-7476-4505-ab40-a3f925cb02ac None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:23.420410 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:23.426802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:23.426802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:23.426802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] PATH_INFO: `/v3/projects/4c8b471b707149398d1213a4a3574b98` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:23.426802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8b471b707149398d1213a4a3574b98)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:23.426802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:23.525442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8b471b707149398d1213a4a3574b98', 'request_id': 'req-64e3390c-5ef3-4081-9580-5e6a4c51e023'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:23.592201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8b471b707149398d1213a4a3574b98', 'request_id': 'req-64e3390c-5ef3-4081-9580-5e6a4c51e023'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:23.598056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8b471b707149398d1213a4a3574b98', 'request_id': 'req-64e3390c-5ef3-4081-9580-5e6a4c51e023'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:23.609121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] The token cache is being invalidate because project 4c8b471b707149398d1213a4a3574b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:23.609409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:23.610031 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-64e3390c-5ef3-4081-9580-5e6a4c51e023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:23.611593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1157/2332] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:23 2022] DELETE /identity/v3/projects/4c8b471b707149398d1213a4a3574b98 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:24.655582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:24.656985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:24.669222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f949b-e231-412c-a502-9f918602e01a service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:24.722124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:24.722972 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:24.723252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:24.723549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] PATH_INFO: `/v3/users/f40976fbb813488bb9d0ddc46d274933` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:24.724708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40976fbb813488bb9d0ddc46d274933)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:24.726604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:24.895573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40976fbb813488bb9d0ddc46d274933'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:24.896157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40976fbb813488bb9d0ddc46d274933'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:24.896754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40976fbb813488bb9d0ddc46d274933'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:24.956855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40976fbb813488bb9d0ddc46d274933'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:24.968402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40976fbb813488bb9d0ddc46d274933'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:24.980117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1176/2333] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:24 2022] DELETE /identity/v3/users/f40976fbb813488bb9d0ddc46d274933 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:24.985305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:24.985771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:24.985868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.003708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:25.004900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:25.061297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1158/2334] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:25.070851 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:25.072288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:25.126888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ece07-2e75-4802-bd24-74b2b8f23099 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:25.130523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:25.131153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.131436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.131762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.140481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:25.141899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046dd91-a6e8-43ca-93e0-8473536c8770 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:25.151167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1177/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:25.548415 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:25.549906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:25.562145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e4e5-033d-4901-9ba3-e8e1641e21e9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:25.566911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:25.567862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.568145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.568418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] PATH_INFO: `/v3/projects/4504503a5a854f8bbae75fb4b20acd8c` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.569735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4504503a5a854f8bbae75fb4b20acd8c)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:25.573035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:25.677546 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4504503a5a854f8bbae75fb4b20acd8c', 'request_id': 'req-d3545633-44c8-44c7-ac10-b5db2941dd04'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:25.746251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4504503a5a854f8bbae75fb4b20acd8c', 'request_id': 'req-d3545633-44c8-44c7-ac10-b5db2941dd04'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:25.751696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4504503a5a854f8bbae75fb4b20acd8c', 'request_id': 'req-d3545633-44c8-44c7-ac10-b5db2941dd04'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:25.762242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] The token cache is being invalidate because project 4504503a5a854f8bbae75fb4b20acd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:25.763021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:25.763674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d3545633-44c8-44c7-ac10-b5db2941dd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:25.765186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1159/2336] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:25 2022] DELETE /identity/v3/projects/4504503a5a854f8bbae75fb4b20acd8c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:25.770007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.770497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.770618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.788803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:25.789963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:25.845629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1178/2337] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:25.853259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.853551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.853856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.871868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:25.873067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:25.880909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1160/2338] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:25.885010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:25.894912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60ef83-5d5f-4a50-b62d-0d157a37fd09 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:25.899358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:25.900026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.900310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.900587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.901298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:25.901599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:25.903822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:25.914761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1179/2339] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:25.918793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:25.927912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683842c2-949a-4c8f-9ada-3bb2d49ba033 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:25.932388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:25.933020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:25.933304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:25.933578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:25.934293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:25.936227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.010382 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1161/2340] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:25 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:26.015157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.024933 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500cfaa-aa0c-4410-94f0-461da1592ab7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.078951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.079636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.079919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.080194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.080877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.082817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.163830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1180/2341] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:26 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:26.168097 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.178702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfda5-33ee-4011-aa44-a4634641a4de admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.183237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.183918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.184704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.184979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.185703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.187317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.197438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1162/2342] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:26.201990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.212113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a6adf-db7d-4c1c-930b-0da8a199deaa admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.217066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.217723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.218007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.218293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.219011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.220656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f1a4f-ebcf-4729-aec1-88bb82924f37 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.230570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1181/2343] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:26.234746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.245090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e902e-e329-4154-927d-88598dd13e7d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.250390 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.251265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.251584 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.251862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] PATH_INFO: `/v3/projects/f95d1bbdf5e14ea6baa1ec745fc78da1/users/6ac9f06f45ce414d80a0492adfd55d77/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.267251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95d1bbdf5e14ea6baa1ec745fc78da1, user_id=6ac9f06f45ce414d80a0492adfd55d77, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.270163 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.352717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1163/2344] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:26 2022] PUT /identity/v3/projects/f95d1bbdf5e14ea6baa1ec745fc78da1/users/6ac9f06f45ce414d80a0492adfd55d77/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:26.364323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.364616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.364892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.392601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] MFA Rules not processed for user `6ac9f06f45ce414d80a0492adfd55d77`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:26.393804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:26.459619 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1182/2345] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:26.463973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.525491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73298-2375-48c5-b429-7cd6daf8821a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.532928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.532928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.532928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.532928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.533328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.534313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.640043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1164/2346] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:26 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:26.644232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.655569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5f9f3-3e50-476d-8892-66122a60f0a1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.710537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.711126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.711410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.716340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.716340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.716340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.792261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1183/2347] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:26 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:26.796736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.807020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d0d42-01ca-4a20-a645-4c36bdb5284b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.812474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.813139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.813445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.813755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.814510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.816178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.826766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1165/2348] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:26.831052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.840364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745d4fe-5033-4b4d-8f55-2f5587eb9489 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.845528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.846194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.846481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.846759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.847510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.849090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef79d0-37c2-4df2-9800-53350ff17e47 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.859206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1184/2349] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:26.863044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:26.872807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcf4a-9a7e-481f-a401-399363fb5426 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:26.877320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:26.878195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:26.878462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:26.878742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] PATH_INFO: `/v3/projects/cea96863c55d4e15a94f29461080f360/users/21d032b954c3443d87fffd921f04cde9/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:26.892666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea96863c55d4e15a94f29461080f360, user_id=21d032b954c3443d87fffd921f04cde9, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:26.895308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:26.998421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1166/2350] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:26 2022] PUT /identity/v3/projects/cea96863c55d4e15a94f29461080f360/users/21d032b954c3443d87fffd921f04cde9/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:27.008541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.008829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.009107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.034662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] MFA Rules not processed for user `21d032b954c3443d87fffd921f04cde9`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:27.035955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:27.097711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1185/2351] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:27.102109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.161290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808883c8-7640-4ebc-a6d6-b797d39bdd30 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.165909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.166551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.166835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.167111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.167834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.170292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.256256 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1167/2352] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:27.260309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.271487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa86b-61a1-4c8f-ab9e-216f3018d3e6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.326558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.327246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.327543 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.327825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.328528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.330446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.431333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1186/2353] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:27 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:27.435207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.445471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72de56-a4df-4eff-aca0-b9c1e34294db admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.450722 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.451379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.451708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.451993 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.452727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.454339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.464209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1168/2354] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:27.469037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.478882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805be39-c12a-45d1-be4e-04ea39c7b4a3 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.483791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.484651 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.487109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.487109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] PATH_INFO: `/v3/projects/62bd5b3599a74d98950a07df693f094c/users/c898e44e2c5740b0b8ef132eb8f21604/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.499144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bd5b3599a74d98950a07df693f094c, user_id=c898e44e2c5740b0b8ef132eb8f21604, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.501828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.569489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1187/2355] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:27 2022] PUT /identity/v3/projects/62bd5b3599a74d98950a07df693f094c/users/c898e44e2c5740b0b8ef132eb8f21604/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:27.574252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.584797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c523-6a24-404d-9279-1fe3f5512dc2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.648012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.648715 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.649003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.649285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.650016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.651700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f97bc-ec0d-45b3-830e-c706aadfbfc6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.661657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1169/2356] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:27.665979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.678288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e9f6-ca31-470a-aed3-864494a16413 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.683706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.685423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.685843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.686118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] PATH_INFO: `/v3/projects/62bd5b3599a74d98950a07df693f094c/users/c898e44e2c5740b0b8ef132eb8f21604/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.688328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bd5b3599a74d98950a07df693f094c, user_id=c898e44e2c5740b0b8ef132eb8f21604, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.691056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.703446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1188/2357] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:27 2022] PUT /identity/v3/projects/62bd5b3599a74d98950a07df693f094c/users/c898e44e2c5740b0b8ef132eb8f21604/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:27.714379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.714687 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.714972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.744225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] MFA Rules not processed for user `c898e44e2c5740b0b8ef132eb8f21604`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:27.745431 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:27.810923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1170/2358] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:27.822158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:27.823968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:27.879325 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed4ee6-cfed-4986-9505-811877fe4c86 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:27.883124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:27.883819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:27.884107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:27.884389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:27.939906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:27.941359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:27.951662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1189/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:30.120176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:30.130444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeccc5-e105-4a3a-9602-1d8888a9400e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:30.136404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:30.137190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:30.137659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:30.137934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:30.197392 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:30.198938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:30.208124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1171/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:31.969537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:31.978114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84384-6398-49bf-91f1-74fe249e64c6 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:31.982417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:31.983061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:31.983349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:31.983664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:31.993427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:31.995147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:32.005530 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1190/2361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:33.223741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:33.223741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:33.305745 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71ca0d-cf39-47c5-8e99-c6ca847b59de service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:33.311746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:33.312673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:33.312955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:33.313279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] PATH_INFO: `/v3/users/6324b4a3b7af4af2a1e598f8089853b6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:33.314735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6324b4a3b7af4af2a1e598f8089853b6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:33.316883 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:33.571539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6324b4a3b7af4af2a1e598f8089853b6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:33.572216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6324b4a3b7af4af2a1e598f8089853b6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:33.572797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6324b4a3b7af4af2a1e598f8089853b6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:33.632211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6324b4a3b7af4af2a1e598f8089853b6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:33.639232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-1198f2cb-7e9d-48ec-a1f3-85c1f4b4583c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6324b4a3b7af4af2a1e598f8089853b6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:33.656538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1172/2362] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:33 2022] DELETE /identity/v3/users/6324b4a3b7af4af2a1e598f8089853b6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:33.889850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:33.900553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcc04f-0c09-478b-ad6f-b18cde5521a2 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:33.957173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:33.958022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:33.958304 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:33.958575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] PATH_INFO: `/v3/projects/24004d6c21a74639aae97880bd275bf2` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:33.959775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] RBAC: Authorizing `identity:delete_project(project_id=24004d6c21a74639aae97880bd275bf2)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:33.961670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.055025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24004d6c21a74639aae97880bd275bf2', 'request_id': 'req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:34.129346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24004d6c21a74639aae97880bd275bf2', 'request_id': 'req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:34.135667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24004d6c21a74639aae97880bd275bf2', 'request_id': 'req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:34.146006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] The token cache is being invalidate because project 24004d6c21a74639aae97880bd275bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:34.146292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:34.146916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-fe7e8fc3-ccd0-462b-94e4-b161ac5bafea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:34.148470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1191/2363] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:33 2022] DELETE /identity/v3/projects/24004d6c21a74639aae97880bd275bf2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:34.154384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.154676 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.154957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.172076 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:34.173531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:34.230851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1173/2364] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:34.238228 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.238526 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.238832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.257204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:34.258533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:34.270957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1192/2365] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:34.271895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.282354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1187e92-575f-4456-b2f2-67c18259c82d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.287271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.287980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.288404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.288686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.289419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:34.289757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.291386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325b72-b582-418f-93a2-52509d142e7b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.304373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1174/2366] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:34.308739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.310927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.311376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.311833 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.318676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8250b4-2fb0-4e42-b58b-c6796d03a62d None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.324082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.324760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.325053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.325340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.326052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.328139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.334270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] MFA Rules not processed for user `3fc372ea5a9e488692c91cb5a75fe219`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:34.334270 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:34.398590 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1175/2367] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:34.422489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1193/2368] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:34.424249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.436235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abcbaf-0fa1-4b5f-a51d-dcbca25b3fa6 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.495147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.495861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.496147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.496923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.497180 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.499124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.554607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1176/2369] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:34.557198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.567456 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8d3a-6a51-418d-ae41-2c8dc156d55d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.572868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.573528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.573849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.574118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.574914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.576455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.589941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1194/2370] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:34.592582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.602844 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cdc74-1328-4837-a7d0-8bccb4a103fc admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.613963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.614862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.615417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.615919 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.616814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.619071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1c6f1-cc96-403a-b557-5557f6924a92 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.629790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1177/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:34.633836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.643766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011639c-b0cc-45bf-a803-6472f96e9e9e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:34.648501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:34.649428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.649653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.649931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] PATH_INFO: `/v3/projects/3e9b4bb7ab7547148bd5ff98514a086d/users/7ca9fc7c9fdd4c7fa113f5854a334017/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.666458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9b4bb7ab7547148bd5ff98514a086d, user_id=7ca9fc7c9fdd4c7fa113f5854a334017, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:34.669794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:34.753023 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1195/2372] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:34 2022] PUT /identity/v3/projects/3e9b4bb7ab7547148bd5ff98514a086d/users/7ca9fc7c9fdd4c7fa113f5854a334017/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:34.763195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:34.763522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:34.763814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:34.794626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] MFA Rules not processed for user `7ca9fc7c9fdd4c7fa113f5854a334017`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:34.795905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:34.879739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1178/2373] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:34.891269 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:34.893675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:35.104681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901bb2a-ef56-4007-9185-91196a1cf609 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:35.111249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:35.111949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:35.112240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:35.112567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:35.120702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:35.122347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d827e-2478-47c7-b7ec-eaa4b4ea5ae3 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:35.131354 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1196/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:35.313789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:35.377006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84aff3-2bcf-42b3-a72e-f9e6ca32406f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:35.381812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:35.382694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:35.382983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:35.383293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] PATH_INFO: `/v3/users/7ca9fc7c9fdd4c7fa113f5854a334017` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:35.384526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca9fc7c9fdd4c7fa113f5854a334017)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:35.386511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:35.564701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca9fc7c9fdd4c7fa113f5854a334017'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:35.565346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca9fc7c9fdd4c7fa113f5854a334017'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:35.565940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca9fc7c9fdd4c7fa113f5854a334017'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:35.620487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca9fc7c9fdd4c7fa113f5854a334017'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:35.627498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca9fc7c9fdd4c7fa113f5854a334017'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:35.644406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1179/2375] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:35 2022] DELETE /identity/v3/users/7ca9fc7c9fdd4c7fa113f5854a334017 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:35.649055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:35.649352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:35.649661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:35.667285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:35.673868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:35.723743 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1197/2376] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:35.733478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:35.734912 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:35.794032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60198d05-1b81-47e7-ad2c-b26ab5101b36 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:35.797929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:35.798566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:35.798847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:35.799118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:35.807881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:35.809313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f733-a19a-4084-8066-a7edfd917dd7 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:35.818735 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1180/2377] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:07:36.210919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.212362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:36.233768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1202-3c51-41d0-845b-e4b16fd16497 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.239725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.240652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.241219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.241333 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] PATH_INFO: `/v3/projects/3e9b4bb7ab7547148bd5ff98514a086d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.242566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9b4bb7ab7547148bd5ff98514a086d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.244630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.352256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9b4bb7ab7547148bd5ff98514a086d', 'request_id': 'req-d3ce880a-8697-4aac-aec5-67df4c1e6309'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:36.420788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9b4bb7ab7547148bd5ff98514a086d', 'request_id': 'req-d3ce880a-8697-4aac-aec5-67df4c1e6309'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:36.427727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9b4bb7ab7547148bd5ff98514a086d', 'request_id': 'req-d3ce880a-8697-4aac-aec5-67df4c1e6309'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:36.439122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] The token cache is being invalidate because project 3e9b4bb7ab7547148bd5ff98514a086d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:36.439414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:36.440077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d3ce880a-8697-4aac-aec5-67df4c1e6309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:36.441625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1198/2378] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:36 2022] DELETE /identity/v3/projects/3e9b4bb7ab7547148bd5ff98514a086d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:36.446625 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.447094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.447216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.464696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:36.465955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:36.524136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1181/2379] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:36.532783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.533075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.533355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.552091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:36.553316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:36.561679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1199/2380] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:36.565858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.575696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6fda-d520-4efc-805e-518f1f7a5dc7 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.580251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.580891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.581175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.581452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.582164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:36.582470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.584105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.595639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1182/2381] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:36.599934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.609329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78621-3dcc-4356-bc80-c525a8f5058a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.614235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.614869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.615156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.615434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.616152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.619250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.691250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1200/2382] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:36 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:36.695159 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.706776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b1b8-b98e-4e25-87e0-6f565d820057 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.763203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.763906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.764197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.764515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.765217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.767152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.844517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1183/2383] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:36 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:36.848654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.858976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c95e53-28f1-4e70-9d10-3d72d33d1051 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.863583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.864227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.864514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.864791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.865510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.867113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.885095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1201/2384] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:36.886316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.897618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286fce7-093f-411d-996a-e2a565b4ce6a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.903182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.903949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.904241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.904527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.905303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.907014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738c8e-62a8-425d-9252-2595723b0118 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:36.918113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1184/2385] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:36.922223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:36.933054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbec7-ee23-4a14-873c-36272828339d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:36.938241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:36.939148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:36.939436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:36.939740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] PATH_INFO: `/v3/projects/aa7f336fc609402aafa8942e3edd946f/users/4abb2d283cff4d918f50705b69b334b3/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:36.955765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7f336fc609402aafa8942e3edd946f, user_id=4abb2d283cff4d918f50705b69b334b3, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:36.958455 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.050816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1202/2386] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:36 2022] PUT /identity/v3/projects/aa7f336fc609402aafa8942e3edd946f/users/4abb2d283cff4d918f50705b69b334b3/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:37.061564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.061878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.062190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.088033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] MFA Rules not processed for user `4abb2d283cff4d918f50705b69b334b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:37.089272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:37.161537 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1185/2387] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:37.166095 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.233803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35c0f-2fd2-49da-87bf-fa25eb1fe4ee admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.239040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.239737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.240026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.240301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.241391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.242950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.340065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1203/2388] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:37 2022] POST /identity/v3/projects => generated 395 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:37.341768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.352613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115e0f-e91c-4e26-bba3-55e0b44a25d3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.409550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.410149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.410436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.410717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.411428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.413404 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.593034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1186/2389] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:37 2022] POST /identity/v3/users => generated 304 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:37.596970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.606960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6cb6-27d1-440e-baff-2044dee2c5f4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.612027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.612670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.612956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.613231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.614001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.615629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.626467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1204/2390] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:37.633454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.643682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c156d35-62a2-4d08-91bf-ce82c029a59e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.648360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.649306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.649597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.649880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] PATH_INFO: `/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f/users/446ed0dc4caf40088f9fe01b3249a68e/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.666895 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ceaf9dc61924b40b9a6d003e6306c0f, user_id=446ed0dc4caf40088f9fe01b3249a68e, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.670695 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.753790 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1187/2391] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:37 2022] PUT /identity/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f/users/446ed0dc4caf40088f9fe01b3249a68e/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:37.759399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.760784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.761139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:37.774188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ef12-26ad-4749-a3bd-c8be5afd5df2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.825923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd568-9a94-4eaa-ac63-3e0076513886 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.831110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.831354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.832048 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.832408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.832514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.832622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.832779 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.833119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] PATH_INFO: `/v3/users/6ac9f06f45ce414d80a0492adfd55d77` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.833485 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.834473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac9f06f45ce414d80a0492adfd55d77)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.835121 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.836712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.849555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1188/2392] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:37.850413 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:37.860075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950775a1-8cd7-499f-988c-8958ae1e60be admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:37.864770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:37.865647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.865933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.866213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] PATH_INFO: `/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f/users/446ed0dc4caf40088f9fe01b3249a68e/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.868264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ceaf9dc61924b40b9a6d003e6306c0f, user_id=446ed0dc4caf40088f9fe01b3249a68e, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:37.870920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d66e4-3fbb-443b-94ac-56bb0dca2b5f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:37.881532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1189/2393] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:37 2022] PUT /identity/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f/users/446ed0dc4caf40088f9fe01b3249a68e/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:37.892327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:37.892624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:37.892964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:37.920437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] MFA Rules not processed for user `446ed0dc4caf40088f9fe01b3249a68e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:37.921614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:37.960143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac9f06f45ce414d80a0492adfd55d77'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:37.961614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac9f06f45ce414d80a0492adfd55d77'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:37.962378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac9f06f45ce414d80a0492adfd55d77'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:37.994858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1190/2394] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:07:38.003745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac9f06f45ce414d80a0492adfd55d77'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:38.005723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:38.007573 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:38.017453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-bbd3c44e-b8e8-4117-80d4-3ab9d62d4828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac9f06f45ce414d80a0492adfd55d77'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:38.032273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1205/2395] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:37 2022] DELETE /identity/v3/users/6ac9f06f45ce414d80a0492adfd55d77 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:38.036706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:38.037001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:38.037282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:38.057694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:38.058915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:38.071840 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510df28-a584-4ec8-863f-045cdab3398f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:38.120404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1206/2396] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:07:38.130551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:38.132173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:38.132859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:38.133149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:38.133428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:38.134739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:38.197386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f135fa-e880-4a75-97c2-144036c3fe3a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:38.200564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:38.202025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:38.202615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:38.202866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:38.203152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:38.203584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:38.212500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1191/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:07:38.214983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:38.216457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:38.226189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1207/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:07:38.415505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:38.425826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf15c2d-46f4-4093-9150-2cb2df0d659f service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:38.430800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:38.432342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:38.432930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:38.433365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:38.435414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:38.505778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:38.507339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:38.517118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1192/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:38.771953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:38.774281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:38.789297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd879309-8bed-4b57-83d5-5d419e41022e service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:38.794642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:38.796162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:38.801465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:38.801465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] PATH_INFO: `/v3/projects/f95d1bbdf5e14ea6baa1ec745fc78da1` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:38.801465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95d1bbdf5e14ea6baa1ec745fc78da1)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:38.801465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:38.947086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95d1bbdf5e14ea6baa1ec745fc78da1', 'request_id': 'req-8b85361b-f185-4627-8d13-3df9640a622a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.009549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95d1bbdf5e14ea6baa1ec745fc78da1', 'request_id': 'req-8b85361b-f185-4627-8d13-3df9640a622a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.016628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95d1bbdf5e14ea6baa1ec745fc78da1', 'request_id': 'req-8b85361b-f185-4627-8d13-3df9640a622a'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.027098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] The token cache is being invalidate because project f95d1bbdf5e14ea6baa1ec745fc78da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:39.027389 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.029226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.031460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1208/2400] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:38 2022] DELETE /identity/v3/projects/f95d1bbdf5e14ea6baa1ec745fc78da1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:39.035262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:39.052855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5bbcb-ff6e-4b87-9c3d-ef2370027891 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:39.109023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:39.110139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:39.110423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:39.110807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] PATH_INFO: `/v3/users/21d032b954c3443d87fffd921f04cde9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:39.111918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d032b954c3443d87fffd921f04cde9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:39.113899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:39.336234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d032b954c3443d87fffd921f04cde9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.336910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d032b954c3443d87fffd921f04cde9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.337521 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d032b954c3443d87fffd921f04cde9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.421615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d032b954c3443d87fffd921f04cde9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.433035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d032b954c3443d87fffd921f04cde9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:39.456441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1193/2401] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:39 2022] DELETE /identity/v3/users/21d032b954c3443d87fffd921f04cde9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:39.851009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:39.852791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:39.867218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85361b-f185-4627-8d13-3df9640a622a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:39.921683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:39.922850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:39.923134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:39.923411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] PATH_INFO: `/v3/projects/cea96863c55d4e15a94f29461080f360` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:39.924618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea96863c55d4e15a94f29461080f360)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:39.926510 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:40.050787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea96863c55d4e15a94f29461080f360', 'request_id': 'req-f0511041-0d58-4cae-8447-f164b91c8e51'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.152185 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea96863c55d4e15a94f29461080f360', 'request_id': 'req-f0511041-0d58-4cae-8447-f164b91c8e51'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.159291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea96863c55d4e15a94f29461080f360', 'request_id': 'req-f0511041-0d58-4cae-8447-f164b91c8e51'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.169342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] The token cache is being invalidate because project cea96863c55d4e15a94f29461080f360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:40.169665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.170297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.172331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1209/2402] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:39 2022] DELETE /identity/v3/projects/cea96863c55d4e15a94f29461080f360 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:40.180454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:40.181973 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:40.195213 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6ce2-5995-473a-beb5-3c3512fc54ed admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:40.253183 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:40.254053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:40.254337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:40.254614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] PATH_INFO: `/v3/users/c898e44e2c5740b0b8ef132eb8f21604` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:40.255863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c898e44e2c5740b0b8ef132eb8f21604)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:40.258084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:40.428977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c898e44e2c5740b0b8ef132eb8f21604'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.429633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c898e44e2c5740b0b8ef132eb8f21604'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.430259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c898e44e2c5740b0b8ef132eb8f21604'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.512528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c898e44e2c5740b0b8ef132eb8f21604'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.520296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8c24e4ef-f0c7-4aa6-9c4a-9f89e86c40a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c898e44e2c5740b0b8ef132eb8f21604'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:40.539757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1194/2403] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:40 2022] DELETE /identity/v3/users/c898e44e2c5740b0b8ef132eb8f21604 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:41.096275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:41.097763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:41.110151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511041-0d58-4cae-8447-f164b91c8e51 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:41.166438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:41.167218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.167542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.167819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] PATH_INFO: `/v3/projects/62bd5b3599a74d98950a07df693f094c` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.168983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bd5b3599a74d98950a07df693f094c)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:41.170963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:41.265474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bd5b3599a74d98950a07df693f094c', 'request_id': 'req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:41.329118 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bd5b3599a74d98950a07df693f094c', 'request_id': 'req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:41.335633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bd5b3599a74d98950a07df693f094c', 'request_id': 'req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:41.345871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] The token cache is being invalidate because project 62bd5b3599a74d98950a07df693f094c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:41.346159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:41.346869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7c98ec63-75f5-4d37-86a4-bf68ff7c8b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:41.348453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1210/2404] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:41 2022] DELETE /identity/v3/projects/62bd5b3599a74d98950a07df693f094c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:41.353374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.353838 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.353976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.371660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:41.372852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:41.430179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1195/2405] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:41.444608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.444898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.445178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.464666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:41.465912 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:41.473962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1211/2406] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:41.478039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:41.488215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca2022-a3cb-4bc3-8918-e15c51926a55 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:41.492991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:41.493673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.493964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.494252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.494982 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:41.495294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:41.497017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:41.508948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1196/2407] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:41.512923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:41.521847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f15fc-abfc-4990-a970-c5f253fd53a7 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:41.526393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:41.527018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.527301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.527609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.528296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:41.530172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:41.609761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1212/2408] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:41 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:41.613991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:41.623778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d11f-a024-4ecd-a859-e5e74e9292f1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:41.678568 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:41.679227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:41.679550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:41.679835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:41.680576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:41.682509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:42.003727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1197/2409] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:41 2022] POST /identity/v3/users => generated 285 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:42.007650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:42.017667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea275-cb3c-460c-9094-1f46064f868e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:42.022417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:42.023072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:42.023360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:42.023673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:42.024399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:42.026194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:42.037002 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1213/2410] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:42.040803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:42.051388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6b5f-b6b7-4ccd-9338-7e3ce2895ccd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:42.056202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:42.059612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:42.059612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:42.059612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:42.059612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:42.060574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b4e3-2ef3-4f12-bc7c-dafdf39410a7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:42.072819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1198/2411] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:42.074302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:42.084674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564528-ed0e-4a15-ae55-fb0a192153c7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:42.089983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:42.091105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:42.091586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:42.096271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] PATH_INFO: `/v3/projects/8febd750553a4265a6e9b2399533c3b9/users/5c62eae25a544763a34cdf7c6d744321/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:42.108544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8febd750553a4265a6e9b2399533c3b9, user_id=5c62eae25a544763a34cdf7c6d744321, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:42.111378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:42.159437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1214/2412] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:42 2022] PUT /identity/v3/projects/8febd750553a4265a6e9b2399533c3b9/users/5c62eae25a544763a34cdf7c6d744321/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:42.174203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:42.174502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:42.174783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:42.202935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] MFA Rules not processed for user `5c62eae25a544763a34cdf7c6d744321`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:42.204102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:42.271386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1199/2413] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:42.284163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:42.285985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:42.350427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec301-d56f-4495-b530-5fda6de6e06b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:42.354178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:42.354868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:42.355154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:42.355436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:42.363864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:42.365348 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147403c7-879b-4283-b66d-3d0013a494ba service glance] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:42.374018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1215/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:43.511317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:43.512772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:43.591006 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63872c-d543-459d-a475-7c8b440e04a1 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:43.596757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:43.596954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:43.597210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:43.597493 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] PATH_INFO: `/v3/users/4abb2d283cff4d918f50705b69b334b3` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:43.598750 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abb2d283cff4d918f50705b69b334b3)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:43.600681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:43.770950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abb2d283cff4d918f50705b69b334b3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:43.771649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abb2d283cff4d918f50705b69b334b3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:43.772283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abb2d283cff4d918f50705b69b334b3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:43.849420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abb2d283cff4d918f50705b69b334b3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:43.856586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abb2d283cff4d918f50705b69b334b3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:43.874136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1200/2415] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:43 2022] DELETE /identity/v3/users/4abb2d283cff4d918f50705b69b334b3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:43.878721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:43.881332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:43.881332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:43.898632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:43.899899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:43.960070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1216/2416] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:43.969597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:43.971023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:44.028551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf375-7ac6-4d43-977e-3fd0664a9e73 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:44.032251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:44.032910 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:44.033193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:44.033465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:44.043126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:44.044612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:44.055552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1201/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:44.434034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:44.435486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:44.450943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390371ff-7498-4d12-8764-e8bfe9e81b25 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:44.456398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:44.457259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:44.457539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:44.457818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] PATH_INFO: `/v3/projects/aa7f336fc609402aafa8942e3edd946f` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:44.459033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7f336fc609402aafa8942e3edd946f)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:44.463223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:44.582168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7f336fc609402aafa8942e3edd946f', 'request_id': 'req-0da14460-d018-44dd-ac76-967a237f9503'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.649202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7f336fc609402aafa8942e3edd946f', 'request_id': 'req-0da14460-d018-44dd-ac76-967a237f9503'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.656621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7f336fc609402aafa8942e3edd946f', 'request_id': 'req-0da14460-d018-44dd-ac76-967a237f9503'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.667895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] The token cache is being invalidate because project aa7f336fc609402aafa8942e3edd946f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:44.668184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.668831 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.670632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1217/2418] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:44 2022] DELETE /identity/v3/projects/aa7f336fc609402aafa8942e3edd946f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:44.674709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:44.684988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4018dc4-a99e-4391-a20e-ba8d4d2d0080 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:44.744324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:44.745196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:44.745479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:44.745771 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] PATH_INFO: `/v3/users/446ed0dc4caf40088f9fe01b3249a68e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:44.746976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446ed0dc4caf40088f9fe01b3249a68e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:44.748955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:44.938859 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446ed0dc4caf40088f9fe01b3249a68e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.939593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446ed0dc4caf40088f9fe01b3249a68e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:44.940194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446ed0dc4caf40088f9fe01b3249a68e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.015460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446ed0dc4caf40088f9fe01b3249a68e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.022785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-3e3eb474-3279-4aa2-9959-acda92ffe951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446ed0dc4caf40088f9fe01b3249a68e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.039724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1202/2419] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:44 2022] DELETE /identity/v3/users/446ed0dc4caf40088f9fe01b3249a68e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:45.462642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:45.464101 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:45.477376 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14460-d018-44dd-ac76-967a237f9503 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:45.539384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:45.540282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:45.540587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:45.540863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] PATH_INFO: `/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:45.542054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ceaf9dc61924b40b9a6d003e6306c0f)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:45.544146 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:45.675054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ceaf9dc61924b40b9a6d003e6306c0f', 'request_id': 'req-6be21251-8c7c-4d2a-b527-173d1c872367'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.735425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ceaf9dc61924b40b9a6d003e6306c0f', 'request_id': 'req-6be21251-8c7c-4d2a-b527-173d1c872367'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.742081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ceaf9dc61924b40b9a6d003e6306c0f', 'request_id': 'req-6be21251-8c7c-4d2a-b527-173d1c872367'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.752309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] The token cache is being invalidate because project 1ceaf9dc61924b40b9a6d003e6306c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:45.752600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.753230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6be21251-8c7c-4d2a-b527-173d1c872367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:45.754845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1218/2420] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:45 2022] DELETE /identity/v3/projects/1ceaf9dc61924b40b9a6d003e6306c0f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:45.759759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:45.760249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:45.760357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:45.780619 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:45.781868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:45.846204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1203/2421] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:45.855759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:45.858150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:45.858150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:45.878871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:45.880202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:45.890800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1219/2422] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:45.895209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:45.905831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593759b-712a-49ea-9691-fd2ed8e8e467 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:45.913366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:45.914343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:45.915118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:45.915848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:45.917039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:45.917587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:45.920852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:45.937848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1204/2423] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:07:45.939860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:45.955570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3956a3-14bb-4e19-9793-4b586b0544bb None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:45.962009 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:45.963045 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:45.963802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:45.964260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:45.965345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:45.968214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.077789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1220/2424] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:45 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:46.079334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.089900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83fece-5130-4506-a51a-51eaddcce64e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.148127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.148798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.149082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.149359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.150055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.152148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.233068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1205/2425] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:46 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:07:46.237076 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.251529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ac4e2-0cd3-46cc-8722-7b1926408ae2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.258971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.259763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.260125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.260478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.261457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.264563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.281852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1221/2426] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:46.289547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.302102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845336-9e93-47a5-9853-d6f0c7984baa admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.308104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.308881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.311044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.311044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.311044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.312717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4267af-513f-4af2-9f8e-e88ca1fa5c79 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.324307 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1206/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:46.329206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.339171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7b4e-4dbd-47a2-9c67-1503f74e33f4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.343997 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.344937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.345245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.345518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] PATH_INFO: `/v3/projects/e639b898e78f486cb64507bdb7d4e176/users/1f7843c83d06464d9bf31f60561227d2/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.359362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e639b898e78f486cb64507bdb7d4e176, user_id=1f7843c83d06464d9bf31f60561227d2, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.362116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.466219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1222/2428] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:46 2022] PUT /identity/v3/projects/e639b898e78f486cb64507bdb7d4e176/users/1f7843c83d06464d9bf31f60561227d2/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:46.476579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.476868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.477143 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.506275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] MFA Rules not processed for user `1f7843c83d06464d9bf31f60561227d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:46.508456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:46.578525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1207/2429] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:46.583347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.644007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95573e5-45e4-4835-be30-116f4596fd28 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.648742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.649397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.649683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.649960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.650660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.652617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.747909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1223/2430] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:46 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:46.752530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.762985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b648a0-ee00-4363-ab02-39fc86bbab9f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.819356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.820061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.820354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.820636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.821330 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.823252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.900958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1208/2431] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:46 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:46.904834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.914921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955854-f597-453d-96e4-cc8c0776ad3e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.919739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.920950 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.921246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.925828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.925828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.925828 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.935592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1224/2432] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:46.940339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.950518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dc9e7-6f37-4278-bce5-56e3dd27dca0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.955341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.956043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.956334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.956614 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:46.957337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:46.958955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614284fe-44d6-4e0e-ac7e-de625cf001dc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:46.968721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1209/2433] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:46.973043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:46.983329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f559c96-8349-4326-9067-09e9b8fde781 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:46.988040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:46.988907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:46.989196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:46.989491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] PATH_INFO: `/v3/projects/1200624f4e1b4911b216b280c8513654/users/62d23af2646743c1a3ecfc3d06e34ef6/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.004091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1200624f4e1b4911b216b280c8513654, user_id=62d23af2646743c1a3ecfc3d06e34ef6, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.006730 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.112708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1225/2434] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:46 2022] PUT /identity/v3/projects/1200624f4e1b4911b216b280c8513654/users/62d23af2646743c1a3ecfc3d06e34ef6/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:47.124102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.124496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.124887 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.151992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] MFA Rules not processed for user `62d23af2646743c1a3ecfc3d06e34ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:47.153137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:47.217999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1210/2435] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:07:47.222732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.282011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bb48-41bf-4dd0-80c2-07d7fc7ae49a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.286581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.287251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.287549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.293507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.293507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.293507 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.437474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1226/2436] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:47 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:47.438858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.449980 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378bd16-dd45-4f8b-9985-bd191529a16b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.530510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.531563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.531996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.532223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.532916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.534931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.650010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1211/2437] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:47 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:07:47.653583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.664416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a885-8c0e-472a-88db-9e6886c20f53 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.669575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.670426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.670716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.671139 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.672047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.674136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.686144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1227/2438] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:47.690529 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.700540 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403fa21-6f22-46c4-9f5c-16091557d702 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.705662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.710743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.710743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.710743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] PATH_INFO: `/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14/users/9163d921944c4db890bc3c90385c20c5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.721827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1eddc59d3f247fb9d6b5d92ea6eac14, user_id=9163d921944c4db890bc3c90385c20c5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.724536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.809547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1212/2439] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:47 2022] PUT /identity/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14/users/9163d921944c4db890bc3c90385c20c5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:47.814264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.824215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02ede5-1f93-4947-b1c6-16447b9b1a80 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.879353 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.880053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.880340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.880615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.881334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.882931 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0358e-4da8-424a-a521-61365811c882 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.892697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1228/2440] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:47.896796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:47.908299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9ef3-2401-4d4e-a2e2-1c751919fa58 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:47.913074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:47.913967 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.914252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.914533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] PATH_INFO: `/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14/users/9163d921944c4db890bc3c90385c20c5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.916645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1eddc59d3f247fb9d6b5d92ea6eac14, user_id=9163d921944c4db890bc3c90385c20c5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:47.919298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:47.930013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1213/2441] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:47 2022] PUT /identity/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14/users/9163d921944c4db890bc3c90385c20c5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:47.940704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:47.941013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:47.941297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:47.969516 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] MFA Rules not processed for user `9163d921944c4db890bc3c90385c20c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:47.970775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:48.037399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1229/2442] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:48.048555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:48.050210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:48.107832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f98fd-b064-40a3-bce4-89b865db109e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:48.111417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:48.112086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:48.112370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:48.112645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:48.121227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:48.122660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:48.132237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1214/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:48.248964 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:48.250362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:48.262451 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e530-0915-450d-a5ab-2115194fcdc0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:48.266120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:48.268116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:48.268116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:48.268116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:48.324857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:48.326311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f673e-c551-46b9-98bf-cc10c28c2b56 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:48.336157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1230/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:52.334405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:52.397752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361bd4a-3639-4d28-b4bc-a99a69644a4e service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:52.402992 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:52.403891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:52.404176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:52.404452 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] PATH_INFO: `/v3/users/1f7843c83d06464d9bf31f60561227d2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:52.405637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7843c83d06464d9bf31f60561227d2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:52.408153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:52.599939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7843c83d06464d9bf31f60561227d2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:52.599939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7843c83d06464d9bf31f60561227d2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:52.599939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7843c83d06464d9bf31f60561227d2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:52.700917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7843c83d06464d9bf31f60561227d2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:52.711425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7843c83d06464d9bf31f60561227d2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:52.742050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1215/2445] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:52 2022] DELETE /identity/v3/users/1f7843c83d06464d9bf31f60561227d2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:52.746901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:52.747498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:52.747822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:52.768774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:52.770021 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:52.833184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1231/2446] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:07:52.842786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:52.844237 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:52.903010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3434-36d7-47ac-bf78-25ab8ce96d15 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:52.906683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:52.907921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:52.908211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:52.908496 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:52.917524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:52.918975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:52.928851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1216/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:53.357635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:53.357635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:53.369299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5993d-f7e8-4bd1-ae60-a67d75f66034 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:53.373883 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:53.375120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:53.375120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:53.375441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] PATH_INFO: `/v3/projects/e639b898e78f486cb64507bdb7d4e176` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:53.377399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e639b898e78f486cb64507bdb7d4e176)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:53.379272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:53.477736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e639b898e78f486cb64507bdb7d4e176', 'request_id': 'req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.539862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e639b898e78f486cb64507bdb7d4e176', 'request_id': 'req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.546647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e639b898e78f486cb64507bdb7d4e176', 'request_id': 'req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.557298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] The token cache is being invalidate because project e639b898e78f486cb64507bdb7d4e176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:53.557583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.558205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.559762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1232/2448] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:53 2022] DELETE /identity/v3/projects/e639b898e78f486cb64507bdb7d4e176 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:53.564370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:53.573835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0017b5-233a-4c23-bbc1-ed68603d6c7c service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:53.629471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:53.630280 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:53.630564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:53.630839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] PATH_INFO: `/v3/users/62d23af2646743c1a3ecfc3d06e34ef6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:53.632094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d23af2646743c1a3ecfc3d06e34ef6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:53.634055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:53.865523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d23af2646743c1a3ecfc3d06e34ef6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.866277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d23af2646743c1a3ecfc3d06e34ef6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.866890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d23af2646743c1a3ecfc3d06e34ef6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.963350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d23af2646743c1a3ecfc3d06e34ef6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.971053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d23af2646743c1a3ecfc3d06e34ef6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:53.988131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1217/2449] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:53 2022] DELETE /identity/v3/users/62d23af2646743c1a3ecfc3d06e34ef6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:54.445174 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:54.446776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:54.461693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb9d1-7e90-4cc6-bbdb-d8b4616fd5d8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:54.527461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:54.528400 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:54.528682 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:54.528956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] PATH_INFO: `/v3/projects/1200624f4e1b4911b216b280c8513654` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:54.530126 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1200624f4e1b4911b216b280c8513654)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:54.532064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:54.650949 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1200624f4e1b4911b216b280c8513654', 'request_id': 'req-5560e81e-a78f-4950-8992-8baf0d4f8987'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.717676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1200624f4e1b4911b216b280c8513654', 'request_id': 'req-5560e81e-a78f-4950-8992-8baf0d4f8987'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.724547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1200624f4e1b4911b216b280c8513654', 'request_id': 'req-5560e81e-a78f-4950-8992-8baf0d4f8987'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.734490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] The token cache is being invalidate because project 1200624f4e1b4911b216b280c8513654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:54.734782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.735408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.736954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1233/2450] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:54 2022] DELETE /identity/v3/projects/1200624f4e1b4911b216b280c8513654 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:54.741059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:54.742743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:54.757804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34634-48af-40d8-b2f7-184c4d5e3250 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:54.810885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:54.811780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:54.812063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:54.812340 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] PATH_INFO: `/v3/users/9163d921944c4db890bc3c90385c20c5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:54.814009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9163d921944c4db890bc3c90385c20c5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:54.815955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:54.961684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9163d921944c4db890bc3c90385c20c5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.962471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9163d921944c4db890bc3c90385c20c5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:54.963074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9163d921944c4db890bc3c90385c20c5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.015032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9163d921944c4db890bc3c90385c20c5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.022606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d6dcc765-348c-4858-a5bd-89d33431d879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9163d921944c4db890bc3c90385c20c5'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.042075 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1218/2451] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:54 2022] DELETE /identity/v3/users/9163d921944c4db890bc3c90385c20c5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:55.404816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:55.406331 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:55.421433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e81e-a78f-4950-8992-8baf0d4f8987 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:55.477145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:55.477999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:55.478283 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:55.478562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] PATH_INFO: `/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:55.479827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1eddc59d3f247fb9d6b5d92ea6eac14)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:55.481732 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:55.607457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1eddc59d3f247fb9d6b5d92ea6eac14', 'request_id': 'req-d12de400-e631-43cf-8f4a-59a79d0d72ab'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.665878 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1eddc59d3f247fb9d6b5d92ea6eac14', 'request_id': 'req-d12de400-e631-43cf-8f4a-59a79d0d72ab'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.672718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1eddc59d3f247fb9d6b5d92ea6eac14', 'request_id': 'req-d12de400-e631-43cf-8f4a-59a79d0d72ab'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.682669 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] The token cache is being invalidate because project b1eddc59d3f247fb9d6b5d92ea6eac14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:55.683496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.683617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d12de400-e631-43cf-8f4a-59a79d0d72ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:55.685148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1234/2452] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:55 2022] DELETE /identity/v3/projects/b1eddc59d3f247fb9d6b5d92ea6eac14 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:55.690976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:55.691269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:55.691574 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:55.710214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:55.711420 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:55.772825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1219/2453] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:55.781490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:55.781753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:55.782155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:55.801985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:55.803167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:55.810796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1235/2454] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:55.814975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:55.824675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aafd9-d4d8-4857-a75d-3f0a76a6c1a4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:55.829149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:55.830336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:55.830744 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:55.831021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:55.831804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:07:55.832112 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:55.833733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:55.845972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1220/2455] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:07:55.850784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:55.861032 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c98f93-c2f8-4305-a3bd-a82468ae3056 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:55.865681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:55.866360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:55.866647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:55.866999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:55.867674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:55.869578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:55.956084 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1236/2456] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:55.960303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:55.971199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655cb3-c81e-4763-a21e-0aa655b93d66 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.025694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.026341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.026628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.026907 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.027629 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.029562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.129294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1221/2457] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:55 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:56.133287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.143991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2ecf-b8e9-4b33-a8c9-97761a7dc770 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.148972 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.149647 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.149928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.150200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.150940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.152569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.162811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1237/2458] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:56.166596 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.176650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25dfeb-e534-4118-aa89-5882f45a56bc admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.181300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.181945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.182228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.182501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.183244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.184950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284bae9-ba6d-46fe-86dc-6ac348e1755d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.195035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1222/2459] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:56.198864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.209092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd6c7-a550-490d-b9f5-37b8ab527f60 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.213755 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.214611 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.214893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.215169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] PATH_INFO: `/v3/projects/ab850c3261d84d89894b2b0b7d04d898/users/c83f17986fda40f8a72945bc8ddccb85/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.229197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab850c3261d84d89894b2b0b7d04d898, user_id=c83f17986fda40f8a72945bc8ddccb85, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.231887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.323706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1238/2460] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:56 2022] PUT /identity/v3/projects/ab850c3261d84d89894b2b0b7d04d898/users/c83f17986fda40f8a72945bc8ddccb85/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:56.336781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.337067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.337349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.363759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] MFA Rules not processed for user `c83f17986fda40f8a72945bc8ddccb85`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:56.364966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:56.428134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1223/2461] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:56.432721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.496186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0615f02-12b2-4425-af3d-f10526ea8274 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.501078 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.502373 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.502664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.502941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.503739 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.505661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.626155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1239/2462] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:07:56 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:56.630906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.641378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818130b3-ac76-429b-b415-d026aa6c4e14 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.702087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.702718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.703007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.703283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.704021 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.709327 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.826550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1224/2463] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:07:56 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:07:56.830531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.840544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d5646-4246-4af6-823a-dd8dad1ef3de admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.845830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.846479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.846767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.847041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.847785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.852729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.860496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1240/2464] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:07:56.865168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.874921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b144d-7444-4e05-b38d-546d03347afb admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:56.879536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:56.880407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:56.881506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:56.881506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] PATH_INFO: `/v3/projects/ee7362d04969433c83ce4a072d4cbffa/users/54494e81392c4856a6940181caabebc8/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:56.895095 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7362d04969433c83ce4a072d4cbffa, user_id=54494e81392c4856a6940181caabebc8, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:56.897789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:56.975605 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1225/2465] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:56 2022] PUT /identity/v3/projects/ee7362d04969433c83ce4a072d4cbffa/users/54494e81392c4856a6940181caabebc8/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:56.980700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:56.991626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111614-e76d-479e-bbf2-e20efb2ed8ed admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:57.045264 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:57.045927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:57.046211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:57.046487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:57.047202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:57.049726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d26fe2-9fab-4745-b724-0981cdb511df admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:57.059243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1241/2466] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:07:57.063354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:57.073582 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492dcd-63c4-4672-87ff-d1e81860d6aa admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:57.078522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:57.079397 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:57.079727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:57.080009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] PATH_INFO: `/v3/projects/ee7362d04969433c83ce4a072d4cbffa/users/54494e81392c4856a6940181caabebc8/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:57.082042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7362d04969433c83ce4a072d4cbffa, user_id=54494e81392c4856a6940181caabebc8, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:57.084746 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:57.095124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1226/2467] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:07:57 2022] PUT /identity/v3/projects/ee7362d04969433c83ce4a072d4cbffa/users/54494e81392c4856a6940181caabebc8/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:57.110025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:57.110321 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:57.110605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:57.137307 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] MFA Rules not processed for user `54494e81392c4856a6940181caabebc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:57.138489 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:57.205211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1242/2468] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:57.216011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:57.218070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:57.277581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99e20-e931-406f-9655-3a55a0d51b53 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:57.281379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:57.282027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:57.282316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:57.282599 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:57.291567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:57.293000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba351be-9dc2-481a-bd64-a1e2f5962259 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:57.303105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1227/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:57.864626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:57.926418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed486c-755b-40ce-92dd-29444109cfb1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:57.930974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:57.931859 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:57.932138 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:57.932423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] PATH_INFO: `/v3/users/c83f17986fda40f8a72945bc8ddccb85` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:57.933614 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83f17986fda40f8a72945bc8ddccb85)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:57.935563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:58.130115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83f17986fda40f8a72945bc8ddccb85'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:58.130788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83f17986fda40f8a72945bc8ddccb85'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:58.131402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83f17986fda40f8a72945bc8ddccb85'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:58.208352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83f17986fda40f8a72945bc8ddccb85'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:58.219903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83f17986fda40f8a72945bc8ddccb85'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:58.232418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1243/2470] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:57 2022] DELETE /identity/v3/users/c83f17986fda40f8a72945bc8ddccb85 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:07:58.237618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:58.238091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:58.238188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:58.255235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:07:58.256454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:58.313623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1228/2471] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:07:58.323579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:58.325052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:58.381473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8395b-d170-423a-bbdd-43ca4e40338d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:58.385167 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:58.385803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:58.386090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:58.386366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:58.395407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:58.397017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:58.406216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1244/2472] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:07:58.793008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:58.794427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:58.807585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c1e6e-443a-417c-bb2f-b82f8150865b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:58.812299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:58.813825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:58.814118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:58.814395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] PATH_INFO: `/v3/projects/ab850c3261d84d89894b2b0b7d04d898` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:58.815613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab850c3261d84d89894b2b0b7d04d898)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:58.817706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:58.917805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab850c3261d84d89894b2b0b7d04d898', 'request_id': 'req-d0479183-4286-42d2-9cd8-877cdcf2ecb3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.008480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab850c3261d84d89894b2b0b7d04d898', 'request_id': 'req-d0479183-4286-42d2-9cd8-877cdcf2ecb3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.014575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab850c3261d84d89894b2b0b7d04d898', 'request_id': 'req-d0479183-4286-42d2-9cd8-877cdcf2ecb3'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.025996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] The token cache is being invalidate because project ab850c3261d84d89894b2b0b7d04d898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:07:59.026281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.026931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.028480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1229/2473] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:58 2022] DELETE /identity/v3/projects/ab850c3261d84d89894b2b0b7d04d898 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:59.032478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:59.042255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b384c0d-c8ea-49c7-bcac-ae5e006ee818 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:59.096105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:59.096960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:59.097274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:59.097549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] PATH_INFO: `/v3/users/54494e81392c4856a6940181caabebc8` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:59.098727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54494e81392c4856a6940181caabebc8)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:59.100694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:07:59.284633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54494e81392c4856a6940181caabebc8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.285213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54494e81392c4856a6940181caabebc8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.285817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54494e81392c4856a6940181caabebc8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.363329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54494e81392c4856a6940181caabebc8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.375480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-75a96b82-9fde-4eec-92c3-4332602de77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54494e81392c4856a6940181caabebc8'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:07:59.387856 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1245/2474] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:07:59 2022] DELETE /identity/v3/users/54494e81392c4856a6940181caabebc8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:07:59.832151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:07:59.833545 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:07:59.846828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479183-4286-42d2-9cd8-877cdcf2ecb3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:07:59.902395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:07:59.903316 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:07:59.903641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:07:59.903922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] PATH_INFO: `/v3/projects/ee7362d04969433c83ce4a072d4cbffa` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:07:59.905108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7362d04969433c83ce4a072d4cbffa)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:07:59.907059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.008569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7362d04969433c83ce4a072d4cbffa', 'request_id': 'req-39317af3-907e-4592-826f-f7c3709d316c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:00.082752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7362d04969433c83ce4a072d4cbffa', 'request_id': 'req-39317af3-907e-4592-826f-f7c3709d316c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:00.088477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7362d04969433c83ce4a072d4cbffa', 'request_id': 'req-39317af3-907e-4592-826f-f7c3709d316c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:00.099694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] The token cache is being invalidate because project ee7362d04969433c83ce4a072d4cbffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:00.099983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:00.100615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-39317af3-907e-4592-826f-f7c3709d316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:00.102133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1230/2475] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:07:59 2022] DELETE /identity/v3/projects/ee7362d04969433c83ce4a072d4cbffa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:00.107129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.107640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.107783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.126054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:00.127257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:00.182799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1246/2476] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:00.190451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.190777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.191058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.210323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:00.211550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:00.219372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1231/2477] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:00.224116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.233533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99163bd7-3ac5-425c-8431-f2e98889bd09 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.238610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.239246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.239559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.239838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.240592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:08:00.240887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.242474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.254064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1247/2478] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:08:00.258309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.267122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afafa-1ee9-45c5-95d5-84bd6f87515d None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.271779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.272417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.272704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.272983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.273666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.275593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.507541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1232/2479] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:00.511745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.521841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82427-4239-443a-9008-f41afce2d675 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.575599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.576281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.576566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.576843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.577523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.579431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.636613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1248/2480] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:00.640723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.650937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736509d4-eeec-4145-ab05-ad58eca27111 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.655539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.656215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.656520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.656793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.657538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.659673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.669850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1233/2481] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:00.674444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.684227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b4e77-e0f4-4a7d-bb64-92aa7a4bf7ea admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.688781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.689424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.689709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.689985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.690702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.692319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0a4b-bad4-4b3c-a9eb-f3764a557aa5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.701796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1249/2482] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:00.705650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.715376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8648-e4b8-455a-8102-a1fc3518d497 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.720062 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.721430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.721719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.722025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] PATH_INFO: `/v3/projects/4355932c7422430e9e5da0d2272bd234/users/193827e935f34af1ab6374ba5de4e815/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.735898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4355932c7422430e9e5da0d2272bd234, user_id=193827e935f34af1ab6374ba5de4e815, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.739094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:00.814000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1234/2483] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:00 2022] PUT /identity/v3/projects/4355932c7422430e9e5da0d2272bd234/users/193827e935f34af1ab6374ba5de4e815/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:00.825230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.825525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.825838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.851544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] MFA Rules not processed for user `193827e935f34af1ab6374ba5de4e815`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:00.852749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:00.914693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1250/2484] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:00.919156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:00.979898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3ccc-d8ed-434d-9831-1fe4528d5bfc admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:00.984767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:00.985443 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:00.985729 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:00.986034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:00.986721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:00.991862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.091955 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1235/2485] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:08:00 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:08:01.093056 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.104358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc754-5008-4b3e-9c08-c151c6efd8ba None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.156720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.157375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.157711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.158558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.159268 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.161217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.230250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1251/2486] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:08:01 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:01.234013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.243915 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e1-525b-4078-8b77-11722aa8c1b1 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.248447 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.249091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.249373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.249645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.250351 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.252473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.262547 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1236/2487] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:01.266445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.276722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbc93-235a-4fcb-93e6-abe6213cf88c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.281277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.282178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.282457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.282770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] PATH_INFO: `/v3/projects/eba39ec4d65342c6b03ee41253d065e5/users/c709808da0e9495c9fb7ca427eaf0262/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.297775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba39ec4d65342c6b03ee41253d065e5, user_id=c709808da0e9495c9fb7ca427eaf0262, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.300597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.362954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1252/2488] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:01 2022] PUT /identity/v3/projects/eba39ec4d65342c6b03ee41253d065e5/users/c709808da0e9495c9fb7ca427eaf0262/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:01.366878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.377684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b9a6-d800-4b7d-8700-c15c2dbebb68 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.430615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.431269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.431581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.431858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.432570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.434152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f0a4b-0d3d-4d12-a4e3-2b91257e99d6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.444259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1237/2489] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:01.448330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.458855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81d13-87e3-4f90-bc9f-392df68c5f5d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.463341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.464227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.464509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.464784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] PATH_INFO: `/v3/projects/eba39ec4d65342c6b03ee41253d065e5/users/c709808da0e9495c9fb7ca427eaf0262/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.466707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba39ec4d65342c6b03ee41253d065e5, user_id=c709808da0e9495c9fb7ca427eaf0262, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.469352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.479144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1253/2490] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:01 2022] PUT /identity/v3/projects/eba39ec4d65342c6b03ee41253d065e5/users/c709808da0e9495c9fb7ca427eaf0262/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:01.488989 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.489208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.489488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.514975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] MFA Rules not processed for user `c709808da0e9495c9fb7ca427eaf0262`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:01.516202 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:01.583665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1238/2491] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:01.600398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.602077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:01.657177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52124628-d74f-498e-ae63-91fd2fb770e4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.661030 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.661680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.662054 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.662342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.671706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.673909 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.683810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1254/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:01.807297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:01.811001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:01.820502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14a24c-5651-48f2-ad18-b0d41b6257ec None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:01.824047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:01.824685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:01.824974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:01.825253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:01.884703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:01.886145 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40722315-a0b1-4d22-9e90-c8be027ffb67 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:01.895601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1239/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:02.376845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:02.441150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063a96b-ad41-403b-b7b0-b15b78c9755d service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:02.445827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:02.446691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:02.446978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:02.447255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] PATH_INFO: `/v3/users/193827e935f34af1ab6374ba5de4e815` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:02.448509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=193827e935f34af1ab6374ba5de4e815)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:02.450460 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:02.702399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193827e935f34af1ab6374ba5de4e815'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:02.703049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193827e935f34af1ab6374ba5de4e815'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:02.703671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193827e935f34af1ab6374ba5de4e815'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:02.774527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193827e935f34af1ab6374ba5de4e815'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:02.786308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193827e935f34af1ab6374ba5de4e815'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:02.798083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1255/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:02 2022] DELETE /identity/v3/users/193827e935f34af1ab6374ba5de4e815 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:02.802536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:02.803013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:02.803111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:02.820705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:02.821786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:02.884109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1240/2495] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:02.895311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:02.896738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:02.952458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0325-0c52-4295-bd03-43c4dff18ddd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:02.956143 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:02.957466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:02.957751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:02.958026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:02.967149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:02.968673 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:02.978311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1256/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:03.376102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:03.377517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:03.392519 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7af46d-c8ca-4da5-bff7-13d00117f516 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:03.400010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:03.400010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:03.400010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:03.400010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] PATH_INFO: `/v3/projects/4355932c7422430e9e5da0d2272bd234` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:03.401035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4355932c7422430e9e5da0d2272bd234)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:03.403090 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:03.493063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4355932c7422430e9e5da0d2272bd234', 'request_id': 'req-d682db70-d64b-43e6-ba2b-04c241cc9138'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.562198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4355932c7422430e9e5da0d2272bd234', 'request_id': 'req-d682db70-d64b-43e6-ba2b-04c241cc9138'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.567689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4355932c7422430e9e5da0d2272bd234', 'request_id': 'req-d682db70-d64b-43e6-ba2b-04c241cc9138'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.578244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] The token cache is being invalidate because project 4355932c7422430e9e5da0d2272bd234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:03.578530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.579142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.580682 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1241/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:03 2022] DELETE /identity/v3/projects/4355932c7422430e9e5da0d2272bd234 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:03.584691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:03.594087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564669cd-ce60-4fd3-9eb7-2dfa6cf373e1 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:03.648184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:03.649037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:03.649324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:03.649626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] PATH_INFO: `/v3/users/c709808da0e9495c9fb7ca427eaf0262` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:03.650886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c709808da0e9495c9fb7ca427eaf0262)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:03.652829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:03.803860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c709808da0e9495c9fb7ca427eaf0262'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.804500 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c709808da0e9495c9fb7ca427eaf0262'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.805094 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c709808da0e9495c9fb7ca427eaf0262'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.877541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c709808da0e9495c9fb7ca427eaf0262'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.889399 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8eec99c6-4c69-47da-981c-7836876ef003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c709808da0e9495c9fb7ca427eaf0262'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:03.901548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1257/2498] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:03 2022] DELETE /identity/v3/users/c709808da0e9495c9fb7ca427eaf0262 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:08:04.330359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:04.332788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:04.348368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682db70-d64b-43e6-ba2b-04c241cc9138 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:04.416395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:04.417524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.417792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.418066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] PATH_INFO: `/v3/projects/eba39ec4d65342c6b03ee41253d065e5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.419324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba39ec4d65342c6b03ee41253d065e5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:04.428191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:04.574863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba39ec4d65342c6b03ee41253d065e5', 'request_id': 'req-fc0723fa-23ee-40e0-9084-6f61f9336aa7'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:04.636968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba39ec4d65342c6b03ee41253d065e5', 'request_id': 'req-fc0723fa-23ee-40e0-9084-6f61f9336aa7'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:04.642730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba39ec4d65342c6b03ee41253d065e5', 'request_id': 'req-fc0723fa-23ee-40e0-9084-6f61f9336aa7'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:04.653475 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] The token cache is being invalidate because project eba39ec4d65342c6b03ee41253d065e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:04.653761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:04.654378 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-fc0723fa-23ee-40e0-9084-6f61f9336aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:04.655946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1242/2499] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:04 2022] DELETE /identity/v3/projects/eba39ec4d65342c6b03ee41253d065e5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:04.661371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.661822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.661914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.680472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:04.681605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:04.736665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1258/2500] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:04.745875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.746164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.746479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.764864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:04.766070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:04.773888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1243/2501] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:04.777952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:04.787363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f4ee6-4cd0-4490-b863-396491025462 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:04.791959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:04.792597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.792880 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.793155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.793874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:08:04.794180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:04.795812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:04.807783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1259/2502] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:08:04.811720 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:04.821239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b9f2-2a66-4b8a-9874-eb6426f55618 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:04.825965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:04.826601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.826880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.827152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.827869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:04.829817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:04.918796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1244/2503] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:08:04 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:04.924072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:04.934568 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a5c4c-724a-4c2d-a072-e911f4921f77 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:04.988419 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:04.989091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:04.989380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:04.989661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:04.990360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:04.992309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.042317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1260/2504] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:08:04 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:05.046380 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.057539 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bde0d2-38a0-4da2-adc8-fe9faec494b0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.062151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.062802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.063087 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.063369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.064119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.065776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.075913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1245/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:05.079708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.089435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59750-2931-4f90-a5c2-5fe98306a94f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.094061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.094704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.094984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.095255 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.096004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.098086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476b759-9593-4264-90b4-aa111ec3247e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.107595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1261/2506] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:05.111461 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.121780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad7285-73d8-402d-a75f-3495792b8e7d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.126309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.127174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.127457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.127765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] PATH_INFO: `/v3/projects/579719801fd9460d8b72d4af5fd94e02/users/90db8b4d83604c9faccadbcae8073039/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.142084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579719801fd9460d8b72d4af5fd94e02, user_id=90db8b4d83604c9faccadbcae8073039, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.144649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.260227 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1246/2507] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:05 2022] PUT /identity/v3/projects/579719801fd9460d8b72d4af5fd94e02/users/90db8b4d83604c9faccadbcae8073039/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:05.270433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.270720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.270996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.296667 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] MFA Rules not processed for user `90db8b4d83604c9faccadbcae8073039`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:05.298099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:05.359087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1262/2508] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:05.370105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.371875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:05.426974 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a91df-905d-4425-ae2e-5166f179cfc7 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.430615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.431251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.431569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.431848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.439866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.441299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550106e9-d80f-4c19-991e-b9c364bd9563 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.449855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1247/2509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:05.469218 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.528724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366423-c738-45b5-bd94-8b4672c148d4 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.533165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.534011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.534316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.535177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] PATH_INFO: `/v3/users/90db8b4d83604c9faccadbcae8073039` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.536390 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90db8b4d83604c9faccadbcae8073039)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.538327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.691524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90db8b4d83604c9faccadbcae8073039'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:05.692201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90db8b4d83604c9faccadbcae8073039'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:05.692814 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90db8b4d83604c9faccadbcae8073039'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:05.740172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90db8b4d83604c9faccadbcae8073039'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:05.752381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90db8b4d83604c9faccadbcae8073039'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:05.765075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1263/2510] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:05 2022] DELETE /identity/v3/users/90db8b4d83604c9faccadbcae8073039 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:05.770146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.770441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.770725 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.787363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:05.788526 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:05.845239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1248/2511] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:05.854649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:05.856062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:05.911676 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddafcb4-df63-45f3-915e-b07301f41f61 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:05.915319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:05.915992 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:05.916274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:05.916546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:05.928626 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:05.930068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde2d7e-2b78-4a70-9b4a-95982fe3eaa0 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:05.939396 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1264/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:06.295803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:06.297481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:06.310879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dbb91-cf82-48ec-8367-f3ac438f431e None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:06.316559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:06.317427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:06.317716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:06.317997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] PATH_INFO: `/v3/projects/579719801fd9460d8b72d4af5fd94e02` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:06.319190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] RBAC: Authorizing `identity:delete_project(project_id=579719801fd9460d8b72d4af5fd94e02)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:06.321174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:06.449228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579719801fd9460d8b72d4af5fd94e02', 'request_id': 'req-10848e1f-5c71-4497-889b-7af8f8defece'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:06.522364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579719801fd9460d8b72d4af5fd94e02', 'request_id': 'req-10848e1f-5c71-4497-889b-7af8f8defece'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:06.528309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579719801fd9460d8b72d4af5fd94e02', 'request_id': 'req-10848e1f-5c71-4497-889b-7af8f8defece'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:06.539839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] The token cache is being invalidate because project 579719801fd9460d8b72d4af5fd94e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:06.540129 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:06.540759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:06.542288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1249/2513] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:06 2022] DELETE /identity/v3/projects/579719801fd9460d8b72d4af5fd94e02 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:16.908121 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:16.908671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:16.908671 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:16.927046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] MFA Rules not processed for user `7d58150b0d994ef5b9e2f45af9d79440`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:16.928929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:16.982961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1265/2514] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:17.017913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:17.019320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:17.075117 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848e1f-5c71-4497-889b-7af8f8defece admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:17.079010 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:17.079728 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:17.080015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:17.080291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:17.082069 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:17.150738 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:17.152152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:17.162743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1250/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:17.434364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:17.438834 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:17.490816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5316b60-1acc-4ac0-a5f4-019f3bbdbe1e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:17.494426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:17.495061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:17.495347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:17.495724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:17.497457 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:17.507291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:17.508740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:17.516888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1266/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:17.569065 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:17.578026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9813-a018-4def-9961-04ab90b04c80 service glance] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:17.581606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:17.582265 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:17.582550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:17.582828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:17.584640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:17.597988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:17.599416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:17.610578 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1251/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:28.168236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:28.169541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:28.185248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e730-fc1d-4dd1-95ac-28e7be0cdabd service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:28.190665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:28.191329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:28.191653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:28.191935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:28.194135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:28.204772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:28.206420 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f44ba-2be0-4b38-a059-62a3ec7cae82 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:28.216001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1267/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:30.966911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:30.968408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:31.031402 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad124-9e6f-4699-be6f-ad6125fea5bd service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:31.038349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:31.038349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:31.038349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:31.038349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] PATH_INFO: `/v3/users/5c62eae25a544763a34cdf7c6d744321` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:31.038810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c62eae25a544763a34cdf7c6d744321)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:31.040954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:31.260488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c62eae25a544763a34cdf7c6d744321'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:31.261134 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c62eae25a544763a34cdf7c6d744321'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:31.261748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c62eae25a544763a34cdf7c6d744321'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:31.351353 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c62eae25a544763a34cdf7c6d744321'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:31.358409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c62eae25a544763a34cdf7c6d744321'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:31.375925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1252/2519] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:30 2022] DELETE /identity/v3/users/5c62eae25a544763a34cdf7c6d744321 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:08:31.380440 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:31.380920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:31.381033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:31.398288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:31.399503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:31.456189 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1268/2520] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:31.466366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:31.467772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:31.523454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39ecf9-1059-4e14-805a-82ff56979770 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:31.527113 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:31.527804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:31.528088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:31.528391 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:31.537266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:31.539359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f66b9-ea23-433f-8f07-a443f4823f0e service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:31.548873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1253/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:32.004380 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.005803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:32.018000 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fddec2-e5bd-4f2c-91e1-46012dc7dfc3 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.023292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.024397 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.024869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.025151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] PATH_INFO: `/v3/projects/8febd750553a4265a6e9b2399533c3b9` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.026579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8febd750553a4265a6e9b2399533c3b9)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.028538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.141135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8febd750553a4265a6e9b2399533c3b9', 'request_id': 'req-7ea5901d-e134-41a3-a5ed-3b9367ba7062'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:32.248481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8febd750553a4265a6e9b2399533c3b9', 'request_id': 'req-7ea5901d-e134-41a3-a5ed-3b9367ba7062'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:32.255113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8febd750553a4265a6e9b2399533c3b9', 'request_id': 'req-7ea5901d-e134-41a3-a5ed-3b9367ba7062'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:32.265754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] The token cache is being invalidate because project 8febd750553a4265a6e9b2399533c3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:32.266041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:32.266655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7ea5901d-e134-41a3-a5ed-3b9367ba7062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:32.268212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1269/2522] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:32 2022] DELETE /identity/v3/projects/8febd750553a4265a6e9b2399533c3b9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:32.273196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.273675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.273767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.291514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:32.292758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:32.351126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1254/2523] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:32.359802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.360093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.360373 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.378562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:32.379782 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:32.388210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1270/2524] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:32.392464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.401964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70778b9c-7748-4f90-ae77-e4ea15fd724c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.406558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.407209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.407520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.407802 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.408556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:08:32.408867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.410503 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.421846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1255/2525] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:08:32.432701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.442114 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852966ef-5c2d-4204-8a71-1967d4b55a3a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.447561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.448214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.448491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.448762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.449473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.451367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.569939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1271/2526] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:08:32 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:08:32.573861 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.583532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e5c17-a4a5-4357-8035-b3ff05ecc306 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.639206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.639904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.640188 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.640464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.641160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.643141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.708522 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1256/2527] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:08:32 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:08:32.711523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.720497 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfe5d9-dd33-4c9f-af42-d1434c28c418 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.725130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.726409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.726840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.727159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.727875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.729465 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.740153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1272/2528] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:32.744716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.754724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f654a-c7f9-420a-901e-892082aa1eda admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.759290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.760049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.760335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.760612 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.761332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.762938 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf77dc-1e35-403a-b917-50f7b0647c7a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.772491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1257/2529] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:32.776544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.786291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e462cb-411a-445d-bd66-23595b759f54 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:32.791595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:32.792459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.792737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.793007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] PATH_INFO: `/v3/projects/867f5ff54ad4450fb203692cdb02bb7a/users/06b19540cc4544e9ad0a7215167a7323/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.808733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=867f5ff54ad4450fb203692cdb02bb7a, user_id=06b19540cc4544e9ad0a7215167a7323, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:32.812010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:32.876735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1273/2530] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:32 2022] PUT /identity/v3/projects/867f5ff54ad4450fb203692cdb02bb7a/users/06b19540cc4544e9ad0a7215167a7323/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:32.887041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:32.887354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:32.887660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:32.913970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] MFA Rules not processed for user `06b19540cc4544e9ad0a7215167a7323`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:32.915102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:32.980469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1258/2531] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:32.992043 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:32.993754 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:33.050284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381bc0-94a4-4e46-81c1-3bcc8a9be93c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:33.054073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:33.054714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:33.055001 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:33.055275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:33.064607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:33.066100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:33.075537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1274/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:34.186314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:34.187987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:34.244309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b342aa-e6e7-44b6-82df-f3f3326ee9e9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:34.247916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:34.248571 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:34.248860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:34.249136 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:34.250971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:34.267575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:34.269047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d5d2d-07be-4f30-9b4a-58f2a345218c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:34.277094 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1259/2533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:38.223087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:38.285527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50d8c5-bf1d-4a1c-9cd2-19c9fe2dbe1b service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:38.290991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:38.291943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:38.292226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:38.292503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] PATH_INFO: `/v3/users/06b19540cc4544e9ad0a7215167a7323` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:38.293736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b19540cc4544e9ad0a7215167a7323)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:38.295686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:38.508855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b19540cc4544e9ad0a7215167a7323'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:38.509620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b19540cc4544e9ad0a7215167a7323'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:38.510434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b19540cc4544e9ad0a7215167a7323'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:38.596860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b19540cc4544e9ad0a7215167a7323'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:38.609794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b19540cc4544e9ad0a7215167a7323'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:38.621441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1275/2534] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:38 2022] DELETE /identity/v3/users/06b19540cc4544e9ad0a7215167a7323 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:08:38.626039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:38.626509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:38.626606 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:38.644074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:38.645324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:38.703706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1260/2535] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:38.714024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:38.715416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:38.770742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72891cb-5e80-449a-a245-44c13b501b5b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:38.774963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:38.775705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:38.775956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:38.776284 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:38.785968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:38.787410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a6d0c-6b80-46d1-a8b4-6a8e52b0be6a service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:38.797827 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1276/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:39.238389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:39.240613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:39.254124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32add-32d5-4aa4-9619-b6f120571261 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:39.259789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:39.260848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.261290 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.261759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] PATH_INFO: `/v3/projects/867f5ff54ad4450fb203692cdb02bb7a` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.263611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=867f5ff54ad4450fb203692cdb02bb7a)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:39.266826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:39.402689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867f5ff54ad4450fb203692cdb02bb7a', 'request_id': 'req-35837046-4056-4496-b073-66f8764f2e3d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:39.499444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867f5ff54ad4450fb203692cdb02bb7a', 'request_id': 'req-35837046-4056-4496-b073-66f8764f2e3d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:39.505513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867f5ff54ad4450fb203692cdb02bb7a', 'request_id': 'req-35837046-4056-4496-b073-66f8764f2e3d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:39.517285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] The token cache is being invalidate because project 867f5ff54ad4450fb203692cdb02bb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:39.517576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:39.518242 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-35837046-4056-4496-b073-66f8764f2e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:39.519884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1261/2537] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:39 2022] DELETE /identity/v3/projects/867f5ff54ad4450fb203692cdb02bb7a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:39.525178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.525687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.525786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.545234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:39.546551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:39.610803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1277/2538] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:39.619869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.620195 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.620482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.639752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:39.641135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:39.649345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1262/2539] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:39.653812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:39.664463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc894-eb76-4d7b-a64f-07aff703cede None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:39.669171 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:39.669914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.670200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.670474 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.671214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:08:39.671550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:39.673439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:39.686572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1278/2540] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:08:39.691124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:39.700939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55998dbc-1d71-491d-842e-6f6897844041 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:39.705970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:39.706633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.706917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.707214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.707966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:39.710548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:39.810020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1263/2541] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:08:39 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:39.814220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:39.824052 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd436eb8-04d5-486a-b9b5-9684365ab5f8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:39.880784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:39.881596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.881922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.882165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.882941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:39.884898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:39.971271 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1279/2542] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:08:39 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:08:39.972964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:39.984114 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce466763-2be8-40f3-9b2b-2a7d07107f98 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:39.988906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:39.989764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:39.990219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:39.990667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:39.991436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:39.993230 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:40.004215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1264/2543] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:08:40.008347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:40.018350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe891c3-a6d3-4482-a484-d3fae04b294a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:40.023699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:40.024434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:40.024789 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:40.025136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:40.025956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:40.027657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5a24-ed8f-4ff6-9206-7b5cc3c8aabe admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:40.039855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1280/2544] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:08:40.043701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:40.053834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4404f4-a736-46d2-824a-b89b29a38f41 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:40.058450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:40.059579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:40.059871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:40.060151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] PATH_INFO: `/v3/projects/edb1b1e83f2345ce81f30f62c91b617b/users/22b03fb1759d43a785c8db5aa0e5f176/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:40.074642 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb1b1e83f2345ce81f30f62c91b617b, user_id=22b03fb1759d43a785c8db5aa0e5f176, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:40.078946 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:40.146442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1265/2545] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:08:40 2022] PUT /identity/v3/projects/edb1b1e83f2345ce81f30f62c91b617b/users/22b03fb1759d43a785c8db5aa0e5f176/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:40.158089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:40.158381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:40.158672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:40.185361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] MFA Rules not processed for user `22b03fb1759d43a785c8db5aa0e5f176`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:40.186528 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:40.251102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1281/2546] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:40.262196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:40.263917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:40.320675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2e4de-cc9e-403e-ade2-01b7b040fda3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:40.324469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:40.325187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:40.325538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:40.325978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:40.335681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:40.337111 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca0f43-f93e-4512-949a-131a4bb4a8d8 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:40.346063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1266/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:40.964894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:40.974704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f2235-2133-4127-b19d-7aabf20f77ac None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:40.979832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:40.980481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:40.980768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:40.981050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:40.982872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:41.046527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:41.048301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:41.058959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1282/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:42.201234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:42.201656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:42.201812 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:42.218795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] MFA Rules not processed for user `22b03fb1759d43a785c8db5aa0e5f176`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:42.221706 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:42.227819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1267/2549] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:08:42.744016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:42.745904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:42.821022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad954b-0b4c-41a0-a0dc-45399c08e1fe service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:42.825918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:42.826550 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:42.826833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:42.827113 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:42.829521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:42.841135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:42.842716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:42.852790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1283/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:44.841255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:44.843952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:44.951044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194479a1-5074-433f-a924-fcf44d1ee48c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:44.958853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:44.959742 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:44.960607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:44.961259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:44.963792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:44.979283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:44.981243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab870472-914a-4a5f-847f-9784f5d88bf8 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:44.999698 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1268/2551] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:49.587342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:49.592540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:49.658158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328245d8-7551-42cb-abeb-c2aa9d3efde5 service placement] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:49.662602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:49.663627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:49.663911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:49.664186 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] PATH_INFO: `/v3/users/3fc372ea5a9e488692c91cb5a75fe219` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:49.665346 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc372ea5a9e488692c91cb5a75fe219)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:49.667249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:49.844337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc372ea5a9e488692c91cb5a75fe219'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:49.845159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc372ea5a9e488692c91cb5a75fe219'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:49.845764 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc372ea5a9e488692c91cb5a75fe219'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:49.877313 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:49.877839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:49.877839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:49.894623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] MFA Rules not processed for user `fd19d3679a484a47a9413975fb45dece`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:08:49.895961 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:49.902717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1269/2552] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:08:49.916565 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc372ea5a9e488692c91cb5a75fe219'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:49.930082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc372ea5a9e488692c91cb5a75fe219'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:49.945007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1284/2553] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:08:49 2022] DELETE /identity/v3/users/3fc372ea5a9e488692c91cb5a75fe219 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:50.209241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:50.211548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:50.223250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:50.223250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:50.232589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf32d1-09e6-4db2-a824-999c07d08882 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:50.281210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f50d-83ff-4c0e-b180-580077e5186a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:50.285027 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:50.285672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:50.285961 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:50.286243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:50.288017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:50.290271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:50.292499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:50.292499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:50.292499 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] PATH_INFO: `/v3/projects/640c9f5539614165bff049a99e1957d2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:50.292889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640c9f5539614165bff049a99e1957d2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:50.294813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:50.298866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:50.300377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:50.309249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1285/2554] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:08:50.522673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640c9f5539614165bff049a99e1957d2', 'request_id': 'req-61bc65e5-fec3-417c-ac07-677f2f4e86e8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:50.573767 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640c9f5539614165bff049a99e1957d2', 'request_id': 'req-61bc65e5-fec3-417c-ac07-677f2f4e86e8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:50.579789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640c9f5539614165bff049a99e1957d2', 'request_id': 'req-61bc65e5-fec3-417c-ac07-677f2f4e86e8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:50.591551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] The token cache is being invalidate because project 640c9f5539614165bff049a99e1957d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:08:50.591837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:50.592462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-61bc65e5-fec3-417c-ac07-677f2f4e86e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:08:50.593995 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1270/2555] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:08:50 2022] DELETE /identity/v3/projects/640c9f5539614165bff049a99e1957d2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:08:53.885965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:08:53.887914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:53.993053 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43337-f4a3-499b-bf6f-e5a808bfcfe7 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:08:54.069368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:08:54.070605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:08:54.070934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:08:54.071210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:08:54.073072 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:08:54.085932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:08:54.087576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:08:54.099917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1286/2556] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:08:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:09:00.972649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dca61-958d-4637-8b88-14cec8c23b72 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:00.973142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dca61-958d-4637-8b88-14cec8c23b72 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:00.973239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dca61-958d-4637-8b88-14cec8c23b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:00.990550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-fc1dca61-958d-4637-8b88-14cec8c23b72 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:00.991932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fc1dca61-958d-4637-8b88-14cec8c23b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:01.045719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1271/2557] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:09:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:01.200855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:01.202313 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:01.267130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091c1b4-e15d-4a1f-82f7-9d2ceba57803 service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:01.271991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:01.272618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:01.272902 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:01.273179 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:01.280922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:01.282485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:01.290212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1287/2558] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:09:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:09:02.071234 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea77-642e-46ed-88eb-849204a769d4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:02.071719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea77-642e-46ed-88eb-849204a769d4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:02.071830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea77-642e-46ed-88eb-849204a769d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:02.089520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-230aea77-642e-46ed-88eb-849204a769d4 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:02.090741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-230aea77-642e-46ed-88eb-849204a769d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:02.097781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1272/2559] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:02.110201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:02.120729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afebd75-d836-4644-9485-d4a5cffc9d41 service swift] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:02.125735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:02.126384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:02.126670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:02.126946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:02.134796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:02.136910 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:02.144708 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1288/2560] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:09:02.750281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3582b0-c64c-4260-b507-2e4377d99fb9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:02.750628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3582b0-c64c-4260-b507-2e4377d99fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:02.755175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3582b0-c64c-4260-b507-2e4377d99fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:02.769214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5f3582b0-c64c-4260-b507-2e4377d99fb9 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:02.770427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5f3582b0-c64c-4260-b507-2e4377d99fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:02.777468 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1273/2561] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:02.789591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:02.800083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f549-682e-4c3c-a9b3-309309101063 service swift] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:02.805345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:02.805981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:02.806272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:02.806551 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:02.815640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:02.817223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:02.825882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1289/2562] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:09:03.393638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:03.394620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:03.395108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:03.415679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:03.417846 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:03.428808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1274/2563] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:09:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:03.440894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:03.452212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efac63-4c17-462b-b8a9-91f4e8c32b15 service swift] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:03.457792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:03.458427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:03.458985 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:03.459282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:03.470341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:03.472270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e4a08-f165-4a54-bd69-1e120c6e0281 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:03.481978 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1290/2564] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:09:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:09:06.078320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:06.079427 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:06.142286 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46a92d-fe8c-4877-9aad-c71d4dbedd56 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:06.146714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:06.147598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:06.147880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:06.148161 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] PATH_INFO: `/v3/users/22b03fb1759d43a785c8db5aa0e5f176` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:06.149337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b03fb1759d43a785c8db5aa0e5f176)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:06.151247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:06.345763 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b03fb1759d43a785c8db5aa0e5f176'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:06.346414 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b03fb1759d43a785c8db5aa0e5f176'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:06.347002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b03fb1759d43a785c8db5aa0e5f176'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:06.424104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b03fb1759d43a785c8db5aa0e5f176'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:06.431177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b03fb1759d43a785c8db5aa0e5f176'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:06.447796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1275/2565] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:09:06 2022] DELETE /identity/v3/users/22b03fb1759d43a785c8db5aa0e5f176 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:09:06.452413 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:06.456762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:06.456762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:06.472098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:06.473302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:06.532483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1291/2566] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:06.541985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:06.545451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:06.599510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940179f-9c93-4b02-a2e1-b0634417f11a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:06.603005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:06.603667 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:06.603949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:06.604241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:06.613393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:06.614811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8fb3-6c22-4e0b-81d8-f7bf03e2d895 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:06.623897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1276/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:09:06.844579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:06.850787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:06.862620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97029f8a-aa58-45f2-ab1e-569366593647 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:06.867246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:06.868134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:06.868411 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:06.868741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] PATH_INFO: `/v3/projects/edb1b1e83f2345ce81f30f62c91b617b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:06.870066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb1b1e83f2345ce81f30f62c91b617b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:06.871995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:06.972388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb1b1e83f2345ce81f30f62c91b617b', 'request_id': 'req-7aa02200-55ee-4823-8eeb-a24e92dde8c5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:07.041699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb1b1e83f2345ce81f30f62c91b617b', 'request_id': 'req-7aa02200-55ee-4823-8eeb-a24e92dde8c5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:07.048214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb1b1e83f2345ce81f30f62c91b617b', 'request_id': 'req-7aa02200-55ee-4823-8eeb-a24e92dde8c5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:07.058833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] The token cache is being invalidate because project edb1b1e83f2345ce81f30f62c91b617b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:09:07.059123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:07.059771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-7aa02200-55ee-4823-8eeb-a24e92dde8c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:07.061371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1292/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:09:06 2022] DELETE /identity/v3/projects/edb1b1e83f2345ce81f30f62c91b617b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:09:07.066451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.066765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.067061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.085068 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:07.086240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:07.147841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1277/2569] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:07.154316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.154609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.154892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.173017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:07.174210 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:07.182116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1293/2570] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:07.186564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.195739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdd00d-5867-4b7f-99fd-51af1897ebf4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.200850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.201484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.201764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.202035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.202743 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:09:07.203047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.204679 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.215665 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1278/2571] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:09:07.219371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.228535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faed61-c15e-41b7-94c7-a21f603ffb83 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.233169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.233824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.234107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.234382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.235061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.236974 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.312921 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1294/2572] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:09:07 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:09:07.316321 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.326886 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3de8-1885-4db3-80c7-cd25ab637694 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.381581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.382238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.382525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.382804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.383518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.385438 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.453109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1279/2573] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:09:07 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:09:07.457152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.467533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c86691-62ef-47a4-b917-c2ed91970bd1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.472181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.472835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.473122 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.473402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.474124 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.475766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.486329 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1295/2574] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:09:07.489934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.500107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84857eb3-ab08-4ebe-98e8-38e86e95df56 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.504653 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.505298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.505586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.505870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.506592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.508226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076e083-e592-4a7f-9730-563317fa0f66 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.517764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1280/2575] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:09:07.521770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.531349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657827d-949a-4360-a8dd-0ba33e31bdf8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.535928 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.536785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.537070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.537347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] PATH_INFO: `/v3/projects/84e783e257f14ce08a23b54fb50f7081/users/f873e65b1f3b40c09caf6a0140b0b8e9/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.551852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e783e257f14ce08a23b54fb50f7081, user_id=f873e65b1f3b40c09caf6a0140b0b8e9, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.554483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.601464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1296/2576] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:09:07 2022] PUT /identity/v3/projects/84e783e257f14ce08a23b54fb50f7081/users/f873e65b1f3b40c09caf6a0140b0b8e9/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:09:07.612215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.614041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.614041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.639364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] MFA Rules not processed for user `f873e65b1f3b40c09caf6a0140b0b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:07.640585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:07.702193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1281/2577] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:07.712725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:07.714533 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:07.768855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9eee-f023-425f-aee1-40021ecaf6ee admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:07.772573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:07.773213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:07.773499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:07.773778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:07.783654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:07.785089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4d32b-77b2-4ba6-8fb4-7de22b126c26 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:07.794574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1297/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:09:28.333218 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:28.358885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a61c-e923-4fe1-aaaa-d133c9af0725 None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.359378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a61c-e923-4fe1-aaaa-d133c9af0725 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.359464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7a61c-e923-4fe1-aaaa-d133c9af0725 None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.361427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1298/2579] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 13:09:28.367226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.367536 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.367822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.386461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] MFA Rules not processed for user `ac94b28422044aed9681b0c31b9ab97e`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:28.388215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.399632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08a678-c757-496c-b7ac-47b1bcc44e89 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:28.404975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:28.405882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.406140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.406418 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] PATH_INFO: `/v3/users/f873e65b1f3b40c09caf6a0140b0b8e9` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.407661 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f873e65b1f3b40c09caf6a0140b0b8e9)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:28.409622 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:28.441662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1299/2580] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:09:28.454125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:28.455462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.466112 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c770a-79f7-4f0d-9494-8d34a13791e3 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:28.469742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:28.470362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.470645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.470917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.477654 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:28.479059 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fc9aa-fe33-4c29-b426-aa97367738ba service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:28.486561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1300/2581] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:09:28.575650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513d3f7-95bf-41a8-96c1-33e436b0ed7b None None] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.575936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513d3f7-95bf-41a8-96c1-33e436b0ed7b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.576241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513d3f7-95bf-41a8-96c1-33e436b0ed7b None None] PATH_INFO: `/` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.578750 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1301/2582] 10.222.0.23 () {54 vars in 921 bytes} [Mon Feb 28 13:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 13:09:28.583368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056bd7-6604-4575-9c86-077ad399f041 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.583797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056bd7-6604-4575-9c86-077ad399f041 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.584081 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056bd7-6604-4575-9c86-077ad399f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.587032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f873e65b1f3b40c09caf6a0140b0b8e9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:28.587708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f873e65b1f3b40c09caf6a0140b0b8e9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:28.588302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f873e65b1f3b40c09caf6a0140b0b8e9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:28.602817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-91056bd7-6604-4575-9c86-077ad399f041 None None] MFA Rules not processed for user `55ae9eb24d0a4617bb52c9680bc7a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:28.604088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-91056bd7-6604-4575-9c86-077ad399f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.647054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f873e65b1f3b40c09caf6a0140b0b8e9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:28.655953 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f873e65b1f3b40c09caf6a0140b0b8e9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:28.676339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1302/2583] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Feb 28 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:09:28.677609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1282/2584] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:09:28 2022] DELETE /identity/v3/users/f873e65b1f3b40c09caf6a0140b0b8e9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:09:28.681957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.682247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.682545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.686523 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:28.687947 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.700850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:28.702075 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.749267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7217faf-2556-47c4-afef-5695e6ec06ed admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:28.753295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:28.754146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.754146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.754434 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.776340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1303/2585] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:09:28.786663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:28.788184 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:28.802060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc853c-297a-41b8-8fe4-378169ca419a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:28.805954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:28.806372 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:28.806659 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:28.807083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:28.817884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:28.819328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:28.830091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1304/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:09:28.838347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:28.840273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e601c-6493-473a-8f17-08ea14ec225a service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:28.852339 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1283/2587] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:09:29.278031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:29.279556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:29.293753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85516e6-d627-4aaa-b506-67c4003ce420 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:29.298345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:29.299370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:29.299698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:29.299979 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] PATH_INFO: `/v3/projects/84e783e257f14ce08a23b54fb50f7081` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:29.301226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e783e257f14ce08a23b54fb50f7081)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:29.303375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:29.411623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e783e257f14ce08a23b54fb50f7081', 'request_id': 'req-0e982c2d-a88e-4237-a1be-c2f5f9ace314'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:29.476558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e783e257f14ce08a23b54fb50f7081', 'request_id': 'req-0e982c2d-a88e-4237-a1be-c2f5f9ace314'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:29.484011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e783e257f14ce08a23b54fb50f7081', 'request_id': 'req-0e982c2d-a88e-4237-a1be-c2f5f9ace314'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:29.500099 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] The token cache is being invalidate because project 84e783e257f14ce08a23b54fb50f7081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:09:29.500774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:29.501678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:09:29.503434 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1305/2588] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:09:29 2022] DELETE /identity/v3/projects/84e783e257f14ce08a23b54fb50f7081 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:09:50.027770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:50.028355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:50.028570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:50.046325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:09:50.047621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:50.102491 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1284/2589] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:09:50.117991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:50.119464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:50.187199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e982c2d-a88e-4237-a1be-c2f5f9ace314 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:50.192287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:50.192932 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:50.193220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:50.193499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:50.201698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:50.203829 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:50.211763 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1306/2590] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:09:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:09:58.578956 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:09:58.581166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:58.647310 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef076-6639-4de2-9c5b-38eddefed592 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:09:58.651335 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:09:58.652643 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:09:58.654119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:09:58.654119 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:09:58.655173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:09:58.740481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:09:58.744070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:09:58.756551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1285/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:03.099303 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:03.101089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:03.115160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934e8f-9663-4f54-9ced-f50cba6e460a service swift] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:03.119837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:03.120701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:03.120984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:03.121261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] PATH_INFO: `/v3/users/fd19d3679a484a47a9413975fb45dece` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:03.122452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd19d3679a484a47a9413975fb45dece)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:03.124408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:03.306298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd19d3679a484a47a9413975fb45dece'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.306967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd19d3679a484a47a9413975fb45dece'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.307633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd19d3679a484a47a9413975fb45dece'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.377760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd19d3679a484a47a9413975fb45dece'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.389971 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-58409fbb-fcca-4900-b79c-55482180b906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd19d3679a484a47a9413975fb45dece'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.402378 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1307/2592] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:03 2022] DELETE /identity/v3/users/fd19d3679a484a47a9413975fb45dece => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:03.620952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:03.631506 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d332d-40b5-413f-9f90-3250db371928 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:03.685563 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:03.686416 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:03.686701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:03.686978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] PATH_INFO: `/v3/projects/0d81f40b84784ce5bc103294dc08507e` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:03.688784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d81f40b84784ce5bc103294dc08507e)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:03.690684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:03.777007 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d81f40b84784ce5bc103294dc08507e', 'request_id': 'req-7622cc78-e425-4cbd-b79f-c4c2f5a77286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.840903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d81f40b84784ce5bc103294dc08507e', 'request_id': 'req-7622cc78-e425-4cbd-b79f-c4c2f5a77286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.846958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d81f40b84784ce5bc103294dc08507e', 'request_id': 'req-7622cc78-e425-4cbd-b79f-c4c2f5a77286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.857730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] The token cache is being invalidate because project 0d81f40b84784ce5bc103294dc08507e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:03.857952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.858570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7622cc78-e425-4cbd-b79f-c4c2f5a77286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:03.860700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1286/2593] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:03 2022] DELETE /identity/v3/projects/0d81f40b84784ce5bc103294dc08507e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:03.865735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:03.866031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:03.866332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:03.883946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:03.885145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:03.942672 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1308/2594] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:03.951160 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:03.951445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:03.951754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:03.970835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:03.972035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:03.979651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1287/2595] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:03.983620 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:03.993879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effb65b-ee02-4ba4-a87d-2a5121b87a95 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:03.998464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:03.999105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:03.999386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:03.999698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.000416 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:10:04.000741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.002341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.013504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1309/2596] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:10:04.017774 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.026791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e570d-9b51-42fb-b88a-47cb4f86abb1 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.031342 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.032527 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.032809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.033083 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.033776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.035724 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.174331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1288/2597] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:04 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:04.178387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.188196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa2b56-e76b-400d-bd15-4910fbf61a49 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.241574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.242227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.242514 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.242792 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.243501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.245425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.320506 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1310/2598] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:04 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:04.324489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.335358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18422e1-fefc-4dc5-8ac3-41c3d78a7d38 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.339948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.340594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.340875 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.341151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.341876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.343486 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.353580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1289/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:04.357324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.367207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f81d-684a-4b8a-87da-3fa7284bf2a9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.371866 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.372521 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.372804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.373082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.373796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.375436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da209-cc08-4c9f-a77a-350f573ef713 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.385871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1311/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:04.390043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.400375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946fcf-cc10-40aa-88d4-360a5b317f6f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.405040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.405918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.406203 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.408593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] PATH_INFO: `/v3/projects/65bbd839d09a457daf2b855d93ea3762/users/3f34445e403b4bfcbeefd163b101d202/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.423831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bbd839d09a457daf2b855d93ea3762, user_id=3f34445e403b4bfcbeefd163b101d202, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.426535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.492426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1290/2601] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:04 2022] PUT /identity/v3/projects/65bbd839d09a457daf2b855d93ea3762/users/3f34445e403b4bfcbeefd163b101d202/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:04.502660 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.502960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.503244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.530105 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] MFA Rules not processed for user `3f34445e403b4bfcbeefd163b101d202`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:04.531324 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:04.592802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1312/2602] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:10:04.597816 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.657104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e524f2-2606-46e8-b81f-69efe3920460 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.661931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.662586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.662874 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.663154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.663963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.665871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.746550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1291/2603] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:04 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:10:04.748890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.760110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb853-3f76-435d-9256-25c90a2f2ae7 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.815195 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.815895 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.816182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.816665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.817369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.819298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.903192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1313/2604] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:04 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:04.907158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.917096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607fa52-65f2-492f-af2a-1dda6eb7aad2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.921834 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.922476 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.922759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.923035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.923781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.925373 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:04.935326 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1292/2605] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:04.939797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:04.949644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd11c-78c9-4aff-8370-1a476718c830 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:04.954923 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:04.955868 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:04.956150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:04.956424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] PATH_INFO: `/v3/projects/717e562c8db84c34b403a500cb42f0f6/users/e194d99a7c744e0e811d256d9cc126da/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:04.970511 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717e562c8db84c34b403a500cb42f0f6, user_id=e194d99a7c744e0e811d256d9cc126da, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:04.973256 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:05.070326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1314/2606] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:04 2022] PUT /identity/v3/projects/717e562c8db84c34b403a500cb42f0f6/users/e194d99a7c744e0e811d256d9cc126da/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:05.074261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:05.083981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a362-4526-4af8-a4bc-431ec6b63cc0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:05.138055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:05.138747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:05.139034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:05.139314 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:05.140077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:05.141913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ee1b-e03a-42bc-aa4f-5c1c864d2790 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:05.151576 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1293/2607] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:05.155723 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:05.166088 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b71a-8302-48ed-8e1c-35616a27b4b8 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:05.171990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:05.173431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:05.173716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:05.173995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] PATH_INFO: `/v3/projects/717e562c8db84c34b403a500cb42f0f6/users/e194d99a7c744e0e811d256d9cc126da/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:05.176061 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717e562c8db84c34b403a500cb42f0f6, user_id=e194d99a7c744e0e811d256d9cc126da, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:05.178731 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:05.190176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1315/2608] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:05 2022] PUT /identity/v3/projects/717e562c8db84c34b403a500cb42f0f6/users/e194d99a7c744e0e811d256d9cc126da/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:05.201283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:05.201572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:05.201849 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:05.227141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] MFA Rules not processed for user `e194d99a7c744e0e811d256d9cc126da`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:05.228408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:05.296601 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1294/2609] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:10:05.314314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:05.316123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:05.371057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdfc7f-4ac3-49ef-9bfb-9d7a55085c54 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:05.374776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:05.375418 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:05.375729 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:05.376007 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:05.384965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:05.386415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc554d-747d-4b80-b632-c3f5e6410fdb service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:05.395893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1316/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:05.699908 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:05.765708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397d9eb-cc22-4d4e-b498-1c5dd1c94bf0 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:05.771072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:05.771986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:05.772271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:05.772550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] PATH_INFO: `/v3/users/3f34445e403b4bfcbeefd163b101d202` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:05.773752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f34445e403b4bfcbeefd163b101d202)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:05.775709 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:05.974484 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f34445e403b4bfcbeefd163b101d202'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:05.975147 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f34445e403b4bfcbeefd163b101d202'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:05.975778 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f34445e403b4bfcbeefd163b101d202'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.034628 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f34445e403b4bfcbeefd163b101d202'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.041825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f34445e403b4bfcbeefd163b101d202'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.058639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1295/2611] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:05 2022] DELETE /identity/v3/users/3f34445e403b4bfcbeefd163b101d202 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:06.063310 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:06.063627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:06.063911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:06.082406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:06.083640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:06.144216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1317/2612] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:06.153913 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:06.155334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:06.215765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9276a4-5dd3-4064-bbac-2adabbdeb4e2 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:06.219669 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:06.220322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:06.220624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:06.220882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:06.230224 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:06.231701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:06.241406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1296/2613] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:06.682577 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:06.687553 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:06.696701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9cef7-c445-4130-962f-3f8e0e4d4a41 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:06.701382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:06.702289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:06.702885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:06.703161 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] PATH_INFO: `/v3/projects/65bbd839d09a457daf2b855d93ea3762` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:06.704381 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bbd839d09a457daf2b855d93ea3762)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:06.706391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:06.853074 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bbd839d09a457daf2b855d93ea3762', 'request_id': 'req-776f4540-0fe9-49f4-912b-6bf5568b1619'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.926431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bbd839d09a457daf2b855d93ea3762', 'request_id': 'req-776f4540-0fe9-49f4-912b-6bf5568b1619'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.933022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bbd839d09a457daf2b855d93ea3762', 'request_id': 'req-776f4540-0fe9-49f4-912b-6bf5568b1619'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.943332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] The token cache is being invalidate because project 65bbd839d09a457daf2b855d93ea3762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:06.943655 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.945483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:06.947503 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1318/2614] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:06 2022] DELETE /identity/v3/projects/65bbd839d09a457daf2b855d93ea3762 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:06.951287 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:06.960729 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8bd6-dc6d-4390-80ca-959e9e16fa78 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:07.016179 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:07.017178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:07.017334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:07.017572 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] PATH_INFO: `/v3/users/e194d99a7c744e0e811d256d9cc126da` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:07.018752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e194d99a7c744e0e811d256d9cc126da)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:07.020712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:07.215428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e194d99a7c744e0e811d256d9cc126da'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.221458 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e194d99a7c744e0e811d256d9cc126da'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.222177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e194d99a7c744e0e811d256d9cc126da'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.292360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e194d99a7c744e0e811d256d9cc126da'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.300030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6e7b65e4-bbd4-4d61-8af4-9436dbe29597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e194d99a7c744e0e811d256d9cc126da'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.316248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1297/2615] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:06 2022] DELETE /identity/v3/users/e194d99a7c744e0e811d256d9cc126da => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:07.722781 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:07.724177 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:07.737446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4540-0fe9-49f4-912b-6bf5568b1619 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:07.795238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:07.796487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:07.796862 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:07.797140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] PATH_INFO: `/v3/projects/717e562c8db84c34b403a500cb42f0f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:07.798327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717e562c8db84c34b403a500cb42f0f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:07.800286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:07.904234 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717e562c8db84c34b403a500cb42f0f6', 'request_id': 'req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.960925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717e562c8db84c34b403a500cb42f0f6', 'request_id': 'req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.967587 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717e562c8db84c34b403a500cb42f0f6', 'request_id': 'req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.977710 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] The token cache is being invalidate because project 717e562c8db84c34b403a500cb42f0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:07.977936 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.978574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2d2e7b10-18f9-48c1-8db0-20bf57db57c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:07.980141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1319/2616] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:07 2022] DELETE /identity/v3/projects/717e562c8db84c34b403a500cb42f0f6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:07.985451 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:07.999408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:07.999408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.003809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:08.005009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:08.064532 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1298/2617] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:08.072391 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.072685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.073086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.091621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:08.092890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:08.101598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1320/2618] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:08.105732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.116281 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0861b-226c-431e-a053-cfc9bf432add None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.120988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.121670 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.122009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.122288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.122999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:10:08.123305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.125016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.137025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1299/2619] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:10:08.141436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.150728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80f323-50b5-4b9a-a840-109b71c89ce0 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.155566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.156216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.156504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.156776 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.157471 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.159358 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.252034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1321/2620] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:08.253148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.263259 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c652d9-40ec-4d25-b260-3c298a9ed105 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.318235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.318905 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.319189 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.319495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.320190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.322108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.395103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1300/2621] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:08.399147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.410604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c842-3894-4abb-b4d2-f69002fbaeff admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.415542 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.416233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.416599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.416826 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.417549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.419297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.431098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1322/2622] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:10:08.435091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.446107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754641-6e14-4a21-b15f-78e09ad5a17a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.451220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.451925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.452217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.452500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.453857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.455702 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67425061-c1e7-462d-9373-619c3abec7b2 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.465986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1301/2623] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:08.470709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.480657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf8cd-2c19-4bf3-80d7-7222ab718510 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.485811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.486674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.486953 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.487230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] PATH_INFO: `/v3/projects/64042acbfc6640ce9d6db3448b45292e/users/3c5921f6fe8443f886e3c1a511ef61ca/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.501336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64042acbfc6640ce9d6db3448b45292e, user_id=3c5921f6fe8443f886e3c1a511ef61ca, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.504135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.601687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1323/2624] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:08 2022] PUT /identity/v3/projects/64042acbfc6640ce9d6db3448b45292e/users/3c5921f6fe8443f886e3c1a511ef61ca/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:08.612664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.612959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.613841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.641587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] MFA Rules not processed for user `3c5921f6fe8443f886e3c1a511ef61ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:08.642788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:08.705854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1302/2625] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:08.710291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.770160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827a4b-3b15-4d65-90a0-d3d14da2d3a0 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.774843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.775505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.775791 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.776064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.776797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.778675 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:08.891334 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1324/2626] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:08.892681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:08.903570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a777-a208-40f4-b015-f55c1d55e5ca None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:08.958884 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:08.959600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:08.959893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:08.960174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:08.960939 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:08.962871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.024617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1303/2627] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:08 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:10:09.028463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.039798 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a70453-14a1-489a-98b6-debc9e9ff488 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.044527 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.049005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.049005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.049005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.049005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.049005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.058983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1325/2628] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:09.063232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.074105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b51842-58a2-44c0-8294-f253007d5028 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.079756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.084385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.084684 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.084971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] PATH_INFO: `/v3/projects/e680904ab895450999aef8040069c9bb/users/71ba6f547e8342079b301a1f12c78628/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.100729 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e680904ab895450999aef8040069c9bb, user_id=71ba6f547e8342079b301a1f12c78628, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.103645 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.182821 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1304/2629] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:09 2022] PUT /identity/v3/projects/e680904ab895450999aef8040069c9bb/users/71ba6f547e8342079b301a1f12c78628/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:10:09.186702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.196947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638e9a4-e290-4498-a513-14876a987cf7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.250055 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.251225 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.251539 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.251820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.252534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.254135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaea78-4f82-4aa1-a2c6-740ebc734144 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.263495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1326/2630] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:09.268403 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.278421 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96539-461f-48b1-958a-447041b1799e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.282959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.283867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.284149 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.284424 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] PATH_INFO: `/v3/projects/e680904ab895450999aef8040069c9bb/users/71ba6f547e8342079b301a1f12c78628/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.286328 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e680904ab895450999aef8040069c9bb, user_id=71ba6f547e8342079b301a1f12c78628, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.289019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.299193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1305/2631] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:09 2022] PUT /identity/v3/projects/e680904ab895450999aef8040069c9bb/users/71ba6f547e8342079b301a1f12c78628/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:09.311098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.311417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.311738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.338717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] MFA Rules not processed for user `71ba6f547e8342079b301a1f12c78628`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:09.339959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:09.410311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1327/2632] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:09.425998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.427711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:09.483429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ade11-a662-4775-8086-5f1af5cba546 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.487639 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.488282 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.488565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.488841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.497651 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.499074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e381-917a-47ad-8f4d-124f3abe7f68 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.508867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1306/2633] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:09.705487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:09.714903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fc8ec-0539-4116-a5a4-0b8fa2e9ac4b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:09.718670 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:09.719576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:09.719817 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:09.720090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:09.774584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:09.776068 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:09.785473 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1328/2634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:10.218897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:10.218897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:10.218897 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:10.237797 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:10.239003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:10.295799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1307/2635] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:10.308487 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:10.309869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:10.376013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1717-07bb-41fb-bc18-3245f5de9794 service cinder] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:10.380903 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:10.381621 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:10.381882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:10.382154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:10.390216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:10.392330 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b003fb-ee0f-465d-9c46-13a9ad619a79 service swift] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:10.400137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1329/2636] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:10:21.557585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:21.616988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212e02-580d-4b52-a07d-10ca4a6f26b3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:21.621456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:21.624140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:21.624140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:21.624140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] PATH_INFO: `/v3/users/3c5921f6fe8443f886e3c1a511ef61ca` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:21.624140 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5921f6fe8443f886e3c1a511ef61ca)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:21.625928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:21.762454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5921f6fe8443f886e3c1a511ef61ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:21.763106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5921f6fe8443f886e3c1a511ef61ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:21.763734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5921f6fe8443f886e3c1a511ef61ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:21.863209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5921f6fe8443f886e3c1a511ef61ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:21.870210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5921f6fe8443f886e3c1a511ef61ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:21.886615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1308/2637] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:21 2022] DELETE /identity/v3/users/3c5921f6fe8443f886e3c1a511ef61ca => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:21.891160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:21.891691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:21.891797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:21.909062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:21.910245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:21.966636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1330/2638] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:21.976632 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:21.978009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:22.039375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97013908-f595-4e73-a8fe-c8257ce62aa0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:22.043827 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:22.044664 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:22.044754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:22.045017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:22.059681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:22.061142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:22.071359 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1309/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:10:22.454044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:22.456153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:22.471042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598d98d-a1c5-4c7b-9f8c-835288587e44 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:22.476148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:22.477003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:22.477286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:22.477560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] PATH_INFO: `/v3/projects/64042acbfc6640ce9d6db3448b45292e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:22.479298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64042acbfc6640ce9d6db3448b45292e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:22.481409 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:22.583736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64042acbfc6640ce9d6db3448b45292e', 'request_id': 'req-8637c28c-c947-4d9a-b1af-78990ea3fb54'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.629104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64042acbfc6640ce9d6db3448b45292e', 'request_id': 'req-8637c28c-c947-4d9a-b1af-78990ea3fb54'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.635301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64042acbfc6640ce9d6db3448b45292e', 'request_id': 'req-8637c28c-c947-4d9a-b1af-78990ea3fb54'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.645734 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] The token cache is being invalidate because project 64042acbfc6640ce9d6db3448b45292e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:22.647808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.647808 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.648214 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1331/2640] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:22 2022] DELETE /identity/v3/projects/64042acbfc6640ce9d6db3448b45292e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:22.652337 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:22.661618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85af779-eb6c-4dc9-bbe3-c33578e8dc97 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:22.716004 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:22.716933 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:22.717228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:22.717500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] PATH_INFO: `/v3/users/71ba6f547e8342079b301a1f12c78628` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:22.718718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ba6f547e8342079b301a1f12c78628)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:22.720741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:22.843085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ba6f547e8342079b301a1f12c78628'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.843799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ba6f547e8342079b301a1f12c78628'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.844405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ba6f547e8342079b301a1f12c78628'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.908405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ba6f547e8342079b301a1f12c78628'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.915498 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e8a7cbe6-2217-4ba6-99c7-ed18aebb60c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ba6f547e8342079b301a1f12c78628'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:22.932817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1310/2641] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:22 2022] DELETE /identity/v3/users/71ba6f547e8342079b301a1f12c78628 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:23.352634 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:23.354080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:23.369632 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c28c-c947-4d9a-b1af-78990ea3fb54 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:23.426292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:23.427147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.427433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.427742 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] PATH_INFO: `/v3/projects/e680904ab895450999aef8040069c9bb` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.428911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e680904ab895450999aef8040069c9bb)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:23.430810 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:23.541689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e680904ab895450999aef8040069c9bb', 'request_id': 'req-3f3a17ef-e20e-4c57-911a-6c99d932119b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:23.622217 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e680904ab895450999aef8040069c9bb', 'request_id': 'req-3f3a17ef-e20e-4c57-911a-6c99d932119b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:23.628525 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e680904ab895450999aef8040069c9bb', 'request_id': 'req-3f3a17ef-e20e-4c57-911a-6c99d932119b'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:23.638442 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] The token cache is being invalidate because project e680904ab895450999aef8040069c9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:23.638724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:23.639350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-3f3a17ef-e20e-4c57-911a-6c99d932119b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:23.640957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1332/2642] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:23 2022] DELETE /identity/v3/projects/e680904ab895450999aef8040069c9bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:23.645868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.646150 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.646426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.663641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:23.664817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:23.720041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1311/2643] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:23.728276 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.728598 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.728879 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.746498 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:23.747709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:23.755524 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1333/2644] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:23.759459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:23.769190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935c31c-04ea-4a2c-89f7-f2723065fe41 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:23.773652 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:23.774285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.774566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.774839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.775577 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:10:23.775882 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:23.777490 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:23.788931 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1312/2645] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:10:23.792860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:23.802006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa20f-9f10-4408-bd50-70cbf38306ed None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:23.806615 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:23.807241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.807564 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.807843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.808519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:23.810404 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:23.887158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1334/2646] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:23.891217 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:23.901531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0d5d7-c565-4f40-824b-43df6ec39519 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:23.955261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:23.956552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:23.956839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:23.957116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:23.957808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:23.959740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.046194 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1313/2647] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:23 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:24.049980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.060768 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35186ae4-3fd1-4f3a-9143-5bc5810d1aba admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.066024 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.066775 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.067063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.067338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.068098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.069769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.080069 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1335/2648] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:24.084516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.094222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c9f0-5435-4acf-a812-1346b484f40c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.098825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.099473 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.099777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.100055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.100776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.102363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd2a6-5211-477e-b659-75e2c83d9df9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.111830 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1314/2649] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:10:24.115678 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.125176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7466a3-0c90-4feb-a56e-6dc297769c13 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.130226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.131080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.131653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.131937 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] PATH_INFO: `/v3/projects/b014264cf57745e9a5fb35412fb606bf/users/d24e3b39706646c187fc33ec9736a13c/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.146091 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b014264cf57745e9a5fb35412fb606bf, user_id=d24e3b39706646c187fc33ec9736a13c, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.148848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.213349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1336/2650] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:24 2022] PUT /identity/v3/projects/b014264cf57745e9a5fb35412fb606bf/users/d24e3b39706646c187fc33ec9736a13c/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:24.226046 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.226338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.226630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.253810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] MFA Rules not processed for user `d24e3b39706646c187fc33ec9736a13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:24.255116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:24.317768 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1315/2651] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:24.322352 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.395607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac0b27-1193-4a71-9871-324f449a985b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.401698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.402365 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.402648 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.402926 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.403663 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.405796 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.516896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1337/2652] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:10:24 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:10:24.521267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.531796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e52f04-cc02-4bfa-9980-5a532bf5b332 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.589814 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.593551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.593551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.593551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.593551 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.593962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.663593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1316/2653] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:10:24 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:10:24.667609 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.678617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c877-fb11-4a65-a8ae-29b3d9c4f36c admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.683345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.684016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.684301 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.684580 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.685308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.686920 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.699242 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1338/2654] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:24.703367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.713457 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6f6f-d3e8-4307-9ff3-2b42954b9ba9 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.719034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.719034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.719964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.719964 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] PATH_INFO: `/v3/projects/0ddc732e2a504472a4dc27d47ab1547a/users/f05b63f4ff864df196f99f7e410211ee/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.734357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddc732e2a504472a4dc27d47ab1547a, user_id=f05b63f4ff864df196f99f7e410211ee, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.738050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.828869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1317/2655] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:24 2022] PUT /identity/v3/projects/0ddc732e2a504472a4dc27d47ab1547a/users/f05b63f4ff864df196f99f7e410211ee/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:24.832790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.842485 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995b369-8eaf-406e-bca0-466b9a78b988 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.896362 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.897033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.897433 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.897721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.898562 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.900207 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac4b43-3b5e-4d1e-bd11-e76610873b9c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.910687 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1339/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:10:24.914950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:24.925976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09484f-dc64-4d11-9a8f-f70a6152c34b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:24.930579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:24.931454 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.931766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.932045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] PATH_INFO: `/v3/projects/0ddc732e2a504472a4dc27d47ab1547a/users/f05b63f4ff864df196f99f7e410211ee/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.934017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddc732e2a504472a4dc27d47ab1547a, user_id=f05b63f4ff864df196f99f7e410211ee, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:24.936716 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:24.946710 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1318/2657] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:10:24 2022] PUT /identity/v3/projects/0ddc732e2a504472a4dc27d47ab1547a/users/f05b63f4ff864df196f99f7e410211ee/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:24.957840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6dac-2637-4aa7-901f-066fac8666f5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:24.958160 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6dac-2637-4aa7-901f-066fac8666f5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:24.958438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d6dac-2637-4aa7-901f-066fac8666f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:24.984037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2c8d6dac-2637-4aa7-901f-066fac8666f5 None None] MFA Rules not processed for user `f05b63f4ff864df196f99f7e410211ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:24.985231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2c8d6dac-2637-4aa7-901f-066fac8666f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:25.051347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1340/2658] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:25.066258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:25.067954 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:25.123435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f734-cbb7-4fe0-b81c-7f3ee9c0579a admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:25.127032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:25.127733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:25.128022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:25.128304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:25.182852 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:25.184329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:25.192934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1319/2659] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:25.912222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:25.912703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:25.912915 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:25.931401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:25.932617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:25.988049 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1341/2660] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:26.000109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:26.001515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:26.067823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b3daa-a476-4584-bb7c-757529256346 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:26.073902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:26.074543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:26.074828 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:26.075103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:26.083379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:26.085026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:26.092918 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1320/2661] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:10:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:10:31.340588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:31.342014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:31.353825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c755-76fc-4abd-b059-0af97418d0e2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:31.357408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:31.358042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:31.358327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:31.358605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:31.367322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:31.368787 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc084-2372-482b-b7f7-b056488c8190 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:31.378037 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1342/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:58.002106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:58.062978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13aad8-928f-4cff-b851-97cad75136f4 service swift] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:58.067456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:58.068323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:58.068604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:58.068917 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] PATH_INFO: `/v3/users/d24e3b39706646c187fc33ec9736a13c` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:58.070122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24e3b39706646c187fc33ec9736a13c)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:58.072056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:58.251937 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24e3b39706646c187fc33ec9736a13c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:58.252509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24e3b39706646c187fc33ec9736a13c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:58.253106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24e3b39706646c187fc33ec9736a13c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:58.325879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24e3b39706646c187fc33ec9736a13c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:58.332646 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24e3b39706646c187fc33ec9736a13c'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:58.348839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1321/2663] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:58 2022] DELETE /identity/v3/users/d24e3b39706646c187fc33ec9736a13c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:58.353436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:58.353918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:58.354033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:58.371132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:10:58.372863 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:58.428472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1343/2664] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:10:58.438507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:58.439950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:58.494206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303ea6-c931-4b44-b17f-728d528c85d6 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:58.498341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:58.498978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:58.499258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:58.499565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:58.509998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:58.512621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:58.522347 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1322/2665] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:10:58.903251 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:58.904733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:58.917623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb372-c66a-46ce-8ee2-4d70269f049a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:58.923990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:58.924847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:58.925129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:58.925406 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] PATH_INFO: `/v3/projects/b014264cf57745e9a5fb35412fb606bf` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:58.926596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b014264cf57745e9a5fb35412fb606bf)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:58.928566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:59.046231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b014264cf57745e9a5fb35412fb606bf', 'request_id': 'req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.113818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b014264cf57745e9a5fb35412fb606bf', 'request_id': 'req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.120100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b014264cf57745e9a5fb35412fb606bf', 'request_id': 'req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.130102 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] The token cache is being invalidate because project b014264cf57745e9a5fb35412fb606bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:10:59.130425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.131048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.132692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1344/2666] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:58 2022] DELETE /identity/v3/projects/b014264cf57745e9a5fb35412fb606bf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:59.136748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:59.146303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e25d8-922f-4557-9aca-1f5239b5335b service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:59.200717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:59.201569 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:59.201853 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:59.202128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] PATH_INFO: `/v3/users/f05b63f4ff864df196f99f7e410211ee` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:59.203295 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05b63f4ff864df196f99f7e410211ee)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:59.205271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:59.339633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05b63f4ff864df196f99f7e410211ee'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.340294 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05b63f4ff864df196f99f7e410211ee'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.340920 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05b63f4ff864df196f99f7e410211ee'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.405349 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05b63f4ff864df196f99f7e410211ee'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.412365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e045406b-bda9-4e94-b5da-b382e2394cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05b63f4ff864df196f99f7e410211ee'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:10:59.429870 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1323/2667] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:10:59 2022] DELETE /identity/v3/users/f05b63f4ff864df196f99f7e410211ee => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:10:59.823546 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:10:59.825079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:10:59.839891 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f533e-d83e-4d33-b2db-cbb2434dcac5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:10:59.895904 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:10:59.896689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:10:59.896981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:10:59.897259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] PATH_INFO: `/v3/projects/0ddc732e2a504472a4dc27d47ab1547a` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:10:59.898426 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddc732e2a504472a4dc27d47ab1547a)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:10:59.900370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:10:59.999938 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddc732e2a504472a4dc27d47ab1547a', 'request_id': 'req-b157db37-2831-42b7-be27-2914fbd6307c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:00.056767 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddc732e2a504472a4dc27d47ab1547a', 'request_id': 'req-b157db37-2831-42b7-be27-2914fbd6307c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:00.063097 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddc732e2a504472a4dc27d47ab1547a', 'request_id': 'req-b157db37-2831-42b7-be27-2914fbd6307c'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:00.073263 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] The token cache is being invalidate because project 0ddc732e2a504472a4dc27d47ab1547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:00.078008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:00.078008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b157db37-2831-42b7-be27-2914fbd6307c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:00.078008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1345/2668] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:10:59 2022] DELETE /identity/v3/projects/0ddc732e2a504472a4dc27d47ab1547a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:00.080727 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.081027 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.081311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.098752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:00.100014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:00.156437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1324/2669] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:00.164035 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.164421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.164728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.183117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:00.184328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:00.192128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1346/2670] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:00.196109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.205935 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684451-6d2e-47da-9193-619816f2b826 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.210495 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.211135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.211417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.211732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.212446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:00.212752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.214375 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.225925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1325/2671] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:00.230044 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.239133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231385df-74dd-4c4a-a7df-969106b5b8c5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.243857 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.244496 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.244785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.245064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.245761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.247799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.332785 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1347/2672] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:00.336868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.348773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d237ce-3383-4b50-ade9-64a9f7add2c7 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.401093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.401748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.402032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.402309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.402991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.405554 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.479888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1326/2673] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:00.484156 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.494079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd41c-d9e2-4c71-ad05-9faa1e8334c5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.498636 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.499273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.499589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.499864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.500572 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.502158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.513617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1348/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:00.517365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.527005 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf131-d6f4-44ed-8bae-8ed4ba4735a8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.532223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.532864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.533152 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.533429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.534141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.535825 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f867f8-6eca-4953-9628-6e85a9d42039 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.545509 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1327/2675] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:00.549319 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.559013 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462a82e-61b7-4430-a88c-5f16e70f2aae admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.564141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.564996 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.565281 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.565556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] PATH_INFO: `/v3/projects/a90a2866d5ba4ebdb98f228d5a6145ca/users/37d2d13b245542ce8a0129f505ae879e/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.580480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90a2866d5ba4ebdb98f228d5a6145ca, user_id=37d2d13b245542ce8a0129f505ae879e, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.583163 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.640128 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1349/2676] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:00 2022] PUT /identity/v3/projects/a90a2866d5ba4ebdb98f228d5a6145ca/users/37d2d13b245542ce8a0129f505ae879e/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:00.651169 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.651465 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.651776 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.677228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] MFA Rules not processed for user `37d2d13b245542ce8a0129f505ae879e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:00.678448 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:00.739978 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1328/2677] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:00.744312 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.802954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032d2d-eb3a-4835-8e46-51cfc9556b97 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.807584 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.808223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.808504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.808854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.809545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.811951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:00.893040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1350/2678] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:00.897239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:00.907866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f6102-8c82-4a56-b337-a54b03bb83a9 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:00.962196 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:00.962909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:00.963187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:00.963459 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:00.964176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:00.966141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.028787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1329/2679] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:00 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:01.032638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:01.042778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61172ad-c925-408c-bb1f-bb5e5f037d8f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:01.048201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:01.048847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.049135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.049412 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.050134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:01.051759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.062749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1351/2680] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:01.066726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:01.076798 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bdc1-01ac-446e-9c34-38fe623344b9 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:01.081873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:01.082757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.083042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.083315 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] PATH_INFO: `/v3/projects/c19f54d09d074958b701f9cdec4cdb65/users/12139c99b5394e87b7f154299bb4d2e5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.097374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19f54d09d074958b701f9cdec4cdb65, user_id=12139c99b5394e87b7f154299bb4d2e5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:01.100063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.148317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1330/2681] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:01 2022] PUT /identity/v3/projects/c19f54d09d074958b701f9cdec4cdb65/users/12139c99b5394e87b7f154299bb4d2e5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:01.152190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:01.162250 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05ec75-db10-48e4-a03e-ba5652037bfa admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:01.216765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:01.217421 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.217709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.217987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.218719 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:01.220355 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704c898-3954-4917-af46-77ce9a8988ad admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.229697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1352/2682] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:01.234318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:01.244247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09ffe-ecb5-4775-bdac-97cd960dc1e4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:01.249456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:01.250325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.250611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.250892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] PATH_INFO: `/v3/projects/c19f54d09d074958b701f9cdec4cdb65/users/12139c99b5394e87b7f154299bb4d2e5/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.252890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19f54d09d074958b701f9cdec4cdb65, user_id=12139c99b5394e87b7f154299bb4d2e5, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:01.255562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.265406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1331/2683] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:01 2022] PUT /identity/v3/projects/c19f54d09d074958b701f9cdec4cdb65/users/12139c99b5394e87b7f154299bb4d2e5/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:01.275111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.275407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.275720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.305048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] MFA Rules not processed for user `12139c99b5394e87b7f154299bb4d2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:01.305048 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:01.368317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1353/2684] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:01.378784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:01.380501 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:01.436167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122d923-a443-43d6-ae76-f630867a28bb admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:01.439815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:01.440453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:01.440739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:01.441020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:01.449862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:01.451369 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5a199-6656-4442-b926-2e20a4e58bdc service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:01.460463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1332/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:02.466712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:02.526366 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2442259-af29-4bdf-9c3e-f2813c551b73 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:02.530854 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:02.531736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:02.532034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:02.532273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] PATH_INFO: `/v3/users/37d2d13b245542ce8a0129f505ae879e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:02.533468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d2d13b245542ce8a0129f505ae879e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:02.535371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:02.726344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d2d13b245542ce8a0129f505ae879e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:02.726947 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d2d13b245542ce8a0129f505ae879e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:02.727650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d2d13b245542ce8a0129f505ae879e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:02.811236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d2d13b245542ce8a0129f505ae879e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:02.823010 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d2d13b245542ce8a0129f505ae879e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:02.835308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1354/2686] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:02 2022] DELETE /identity/v3/users/37d2d13b245542ce8a0129f505ae879e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:02.839829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:02.840302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:02.840405 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:02.858579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:02.859785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:02.915673 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1333/2687] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:02.925398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:02.926822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:02.982638 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa11831-7a1b-46cc-8b58-1078356f2f7d admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:02.986260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:02.986905 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:02.987194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:02.987488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:02.996716 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:02.998656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:03.008026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1355/2688] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:03.389902 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:03.391370 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:03.402970 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080b6f-7b3b-47ec-bc11-58f45566a726 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:03.407904 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:03.408762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:03.409045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:03.409324 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] PATH_INFO: `/v3/projects/a90a2866d5ba4ebdb98f228d5a6145ca` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:03.410505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90a2866d5ba4ebdb98f228d5a6145ca)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:03.412462 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:03.507773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90a2866d5ba4ebdb98f228d5a6145ca', 'request_id': 'req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.553555 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90a2866d5ba4ebdb98f228d5a6145ca', 'request_id': 'req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.559050 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90a2866d5ba4ebdb98f228d5a6145ca', 'request_id': 'req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.569976 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] The token cache is being invalidate because project a90a2866d5ba4ebdb98f228d5a6145ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:03.570241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.570862 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.572441 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1334/2689] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:03 2022] DELETE /identity/v3/projects/a90a2866d5ba4ebdb98f228d5a6145ca => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:03.576415 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:03.585849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e4a5-97a1-436b-bc16-e5713ddb42bd service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:03.638809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:03.639692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:03.639976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:03.640252 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] PATH_INFO: `/v3/users/12139c99b5394e87b7f154299bb4d2e5` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:03.641423 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12139c99b5394e87b7f154299bb4d2e5)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:03.643337 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:03.772231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12139c99b5394e87b7f154299bb4d2e5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.772786 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12139c99b5394e87b7f154299bb4d2e5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.773374 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12139c99b5394e87b7f154299bb4d2e5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.816388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12139c99b5394e87b7f154299bb4d2e5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.827561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-55847d0c-9d91-468e-be93-5a47bbcb7158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12139c99b5394e87b7f154299bb4d2e5'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:03.839308 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1356/2690] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:03 2022] DELETE /identity/v3/users/12139c99b5394e87b7f154299bb4d2e5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:04.207561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.209012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:04.222671 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5acb0-bb54-450d-a05c-da0c9de63b5e admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:04.276647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:04.277513 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.277808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.278089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] PATH_INFO: `/v3/projects/c19f54d09d074958b701f9cdec4cdb65` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.280060 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19f54d09d074958b701f9cdec4cdb65)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:04.281923 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:04.376174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19f54d09d074958b701f9cdec4cdb65', 'request_id': 'req-63655eb0-f5d5-4790-8b85-100026045c0b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:04.468338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19f54d09d074958b701f9cdec4cdb65', 'request_id': 'req-63655eb0-f5d5-4790-8b85-100026045c0b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:04.474585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19f54d09d074958b701f9cdec4cdb65', 'request_id': 'req-63655eb0-f5d5-4790-8b85-100026045c0b'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:04.485799 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] The token cache is being invalidate because project c19f54d09d074958b701f9cdec4cdb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:04.486084 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:04.488445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-63655eb0-f5d5-4790-8b85-100026045c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:04.488445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1335/2691] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:04 2022] DELETE /identity/v3/projects/c19f54d09d074958b701f9cdec4cdb65 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:04.493300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.493661 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.494033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.516153 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:04.517976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:04.576544 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1357/2692] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:04.585029 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c855d-3646-41fc-9483-35c236742007 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.585325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c855d-3646-41fc-9483-35c236742007 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.586009 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c855d-3646-41fc-9483-35c236742007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.603962 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-063c855d-3646-41fc-9483-35c236742007 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:04.605247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-063c855d-3646-41fc-9483-35c236742007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:04.613356 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1336/2693] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:04.617637 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.627884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca6f7b-8cca-450d-ab54-50172290569c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:04.632512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:04.633148 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.633461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.633752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.634445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:04.634747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:04.636364 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:04.648454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1358/2694] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:04.652528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c855d-3646-41fc-9483-35c236742007 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.661686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c855d-3646-41fc-9483-35c236742007 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:04.666589 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:04.667233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.667548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.667829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.668544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:04.671251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:04.801894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1337/2695] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:04.805846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.815759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e4150-f5bb-48c8-80eb-b4c3ce151967 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:04.869701 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:04.870344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.870641 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.870901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.871629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:04.873623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:04.948765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1359/2696] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:04 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:04.953198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.963388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7796b-1f5c-4a36-974a-f94f0efc57bd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:04.968623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:04.969266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:04.969548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:04.969857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:04.970575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:04.973014 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:04.984773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1338/2697] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:04.988467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:04.999300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801778-78b4-49fe-bbed-418085469e27 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:05.003951 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:05.004603 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:05.004885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:05.005159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:05.005872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:05.007447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5e-6d3c-4f7e-bf68-fce5fed281a1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:05.017875 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1360/2698] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:05.022144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:05.032600 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb60dc8-d935-4f89-8496-ed3f1892e45f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:05.037291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:05.038176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:05.038456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:05.038733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] PATH_INFO: `/v3/projects/0a8c0a8d98e647eb9e2f4f29108b2161/users/f8af4962ea1d4b65b28c778a853c4089/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:05.053204 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8c0a8d98e647eb9e2f4f29108b2161, user_id=f8af4962ea1d4b65b28c778a853c4089, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:05.055848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:05.126099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1339/2699] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:05 2022] PUT /identity/v3/projects/0a8c0a8d98e647eb9e2f4f29108b2161/users/f8af4962ea1d4b65b28c778a853c4089/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:05.136991 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:05.137287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:05.137571 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:05.163916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] MFA Rules not processed for user `f8af4962ea1d4b65b28c778a853c4089`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:05.165155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:05.226017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1361/2700] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:05.237052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:05.238747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:05.293078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcfc82-78bf-4511-8bb0-d3a08f771b12 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:05.297035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:05.297666 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:05.297948 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:05.298222 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:05.308878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:05.308878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:05.316674 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1340/2701] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:10.398955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:10.400398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:10.459137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04d26c-4b09-4d04-be8c-82117c089e05 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:10.462616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:10.463257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:10.463569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:10.463847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:10.465596 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:10.523652 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:10.525130 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:10.534691 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1362/2702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:12.005482 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:12.007210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:12.024166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc39be-e9a0-42fa-b6c4-cf16b7de9fa4 service glance] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:12.027966 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:12.028617 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:12.028900 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:12.029175 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:12.031460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:12.117000 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:12.120240 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:12.131854 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1341/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:16.248092 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:16.252259 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:16.270558 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5774047-e715-43e7-af06-b965a84863ee service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:16.276116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:16.276756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:16.277047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:16.277339 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] PATH_INFO: `/v3/users/7d58150b0d994ef5b9e2f45af9d79440` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:16.278519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d58150b0d994ef5b9e2f45af9d79440)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:16.281025 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:16.501041 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d58150b0d994ef5b9e2f45af9d79440'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:16.501625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d58150b0d994ef5b9e2f45af9d79440'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:16.502240 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d58150b0d994ef5b9e2f45af9d79440'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:16.570765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d58150b0d994ef5b9e2f45af9d79440'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:16.583588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-91645c5a-c870-482f-9ad1-f60dc59847a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d58150b0d994ef5b9e2f45af9d79440'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:16.595876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1363/2704] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:16 2022] DELETE /identity/v3/users/7d58150b0d994ef5b9e2f45af9d79440 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:16.818795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:16.831085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3518e-d194-43b6-892c-11865743f33c service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:16.894977 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:16.896023 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:16.896311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:16.896593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] PATH_INFO: `/v3/projects/07d68bed67d94a8b8444e458057e60e4` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:16.897824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d68bed67d94a8b8444e458057e60e4)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:16.899783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.005879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d68bed67d94a8b8444e458057e60e4', 'request_id': 'req-0b8fb5f3-5fd7-4247-887c-92265291f325'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:17.056829 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d68bed67d94a8b8444e458057e60e4', 'request_id': 'req-0b8fb5f3-5fd7-4247-887c-92265291f325'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:17.063008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d68bed67d94a8b8444e458057e60e4', 'request_id': 'req-0b8fb5f3-5fd7-4247-887c-92265291f325'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:17.074146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] The token cache is being invalidate because project 07d68bed67d94a8b8444e458057e60e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:17.074435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:17.075049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0b8fb5f3-5fd7-4247-887c-92265291f325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:17.076916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1342/2705] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:16 2022] DELETE /identity/v3/projects/07d68bed67d94a8b8444e458057e60e4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:17.082459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.082773 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.083051 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.101245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:17.102462 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.160040 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1364/2706] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:17.167864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.168154 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.168449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.192885 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:17.194110 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.202463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1343/2707] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:17.210401 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.220697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a21b-631d-45c4-ac3b-3db943f4208e None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.225342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.225993 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.226279 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.226561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.227285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:17.227635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.229273 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.241606 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1365/2708] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:17.246594 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.257122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148b42-9099-4435-94ea-5e50eb480e1a None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.262082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.262734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.263032 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.263291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.264019 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.266581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.354880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1344/2709] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:17.355502 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.366728 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc1d5-6ee9-4be5-9f2c-d234e96fa665 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.424057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.424724 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.425016 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.425299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.425987 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.427945 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.500357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.502182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.557178 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1366/2710] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:17 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:17.557406 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faedc9a-2c00-495e-b2e2-2d14867e856d admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.558245 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.560780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.566419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.566419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.566419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.566419 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.568561 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d4c7e-02fc-4777-8817-8d2cb5e5061a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.573203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.573881 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.574168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.574449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.575199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.576696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.576824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.578085 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.586493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1367/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:17.587878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1345/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:11:17.591227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.601323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20225-ee73-4779-b83a-50abb6d476e2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.605683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.606344 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.606635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.606916 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.607683 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.609807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acb482-660e-46e7-8d0f-3c6cf8240a55 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.621187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1368/2713] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:17.625911 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.635309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1d48-d3f1-4da9-bf88-01af071fc833 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.642319 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.643201 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.643508 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.643795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] PATH_INFO: `/v3/projects/1e4ff8ae79d04c8aaa0b36ca94ebc456/users/962f24d763a44e41985dee5944334dcb/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.658591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4ff8ae79d04c8aaa0b36ca94ebc456, user_id=962f24d763a44e41985dee5944334dcb, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.661284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.760789 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1346/2714] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:17 2022] PUT /identity/v3/projects/1e4ff8ae79d04c8aaa0b36ca94ebc456/users/962f24d763a44e41985dee5944334dcb/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:17.771861 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.772151 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.772450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.801579 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] MFA Rules not processed for user `962f24d763a44e41985dee5944334dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:17.803089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.865145 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1369/2715] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:17.875409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:17.877267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:17.950662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab5d78-20e8-43cc-bdfb-a8629eedf8ab admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:17.956331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:17.956985 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:17.957275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:17.957559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:17.965444 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:17.967038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:17.976333 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1347/2716] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:25.065556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:25.067187 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:25.132342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014acbf-9441-4da9-96b8-ba4a7456ca0f None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:25.137046 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:25.137911 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:25.138198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:25.138475 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] PATH_INFO: `/v3/users/de83af66daf44bbc8fe7b916187e22cf` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:25.139699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de83af66daf44bbc8fe7b916187e22cf)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:25.141665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:25.351274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de83af66daf44bbc8fe7b916187e22cf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.351975 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de83af66daf44bbc8fe7b916187e22cf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.353270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de83af66daf44bbc8fe7b916187e22cf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.428014 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de83af66daf44bbc8fe7b916187e22cf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.440213 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de83af66daf44bbc8fe7b916187e22cf'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.452110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1370/2717] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:25 2022] DELETE /identity/v3/users/de83af66daf44bbc8fe7b916187e22cf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:25.509719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:25.511141 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:25.586469 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c538abd-50ef-4e93-961e-8e27a55f2855 service nova] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:25.645805 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:25.646456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:25.646741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:25.647018 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:25.648822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:25.659713 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:25.661320 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:25.671186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1348/2718] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:25.687629 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:25.690135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:25.756504 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142d682-87fc-49df-9f4a-1c8b305828b2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:25.761318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:25.762188 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:25.762476 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:25.762749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] PATH_INFO: `/v3/projects/91a0fe7cf4f342fd972e60973badf7ce` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:25.763944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a0fe7cf4f342fd972e60973badf7ce)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:25.766159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:25.856253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a0fe7cf4f342fd972e60973badf7ce', 'request_id': 'req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.908258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a0fe7cf4f342fd972e60973badf7ce', 'request_id': 'req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.914955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a0fe7cf4f342fd972e60973badf7ce', 'request_id': 'req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.925954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] The token cache is being invalidate because project 91a0fe7cf4f342fd972e60973badf7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:25.926243 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.926908 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:25.928737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1371/2719] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:25 2022] DELETE /identity/v3/projects/91a0fe7cf4f342fd972e60973badf7ce => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:25.932686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:25.945567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e693954-58cd-4efb-82c6-c85f07f1ed48 service placement] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:26.008609 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:26.009479 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:26.009757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:26.010030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] PATH_INFO: `/v3/users/90362dff2ecf4e189d50c57dbdbc34b2` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:26.011187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90362dff2ecf4e189d50c57dbdbc34b2)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:26.013236 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:26.155124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90362dff2ecf4e189d50c57dbdbc34b2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.155824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90362dff2ecf4e189d50c57dbdbc34b2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.156445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90362dff2ecf4e189d50c57dbdbc34b2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.233860 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90362dff2ecf4e189d50c57dbdbc34b2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.241371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90362dff2ecf4e189d50c57dbdbc34b2'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.258125 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1349/2720] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:25 2022] DELETE /identity/v3/users/90362dff2ecf4e189d50c57dbdbc34b2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:26.497846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:26.499326 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:26.512689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c6de-fb9a-4b06-96d0-59f1e7c3cbac admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:26.570483 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:26.571349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:26.571664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:26.571939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] PATH_INFO: `/v3/projects/8920d187f7a64f4595b6ad4d5531255f` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:26.573107 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8920d187f7a64f4595b6ad4d5531255f)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:26.575026 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:26.630445 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:26.631892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:26.644608 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a113e-22c9-437a-9ba1-bd76af3cd64c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:26.649086 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:26.649979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:26.650266 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:26.650536 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] PATH_INFO: `/v3/users/f8af4962ea1d4b65b28c778a853c4089` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:26.651733 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8af4962ea1d4b65b28c778a853c4089)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:26.653641 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:26.669518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8920d187f7a64f4595b6ad4d5531255f', 'request_id': 'req-0f3feaa3-17c3-4868-9831-481eb159dc97'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.708142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8920d187f7a64f4595b6ad4d5531255f', 'request_id': 'req-0f3feaa3-17c3-4868-9831-481eb159dc97'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.714566 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8920d187f7a64f4595b6ad4d5531255f', 'request_id': 'req-0f3feaa3-17c3-4868-9831-481eb159dc97'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.724519 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] The token cache is being invalidate because project 8920d187f7a64f4595b6ad4d5531255f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:26.724806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.725427 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0f3feaa3-17c3-4868-9831-481eb159dc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.726966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1372/2721] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:26 2022] DELETE /identity/v3/projects/8920d187f7a64f4595b6ad4d5531255f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:26.847930 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8af4962ea1d4b65b28c778a853c4089'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.848603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8af4962ea1d4b65b28c778a853c4089'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.849198 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8af4962ea1d4b65b28c778a853c4089'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.925565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8af4962ea1d4b65b28c778a853c4089'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.933066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8af4962ea1d4b65b28c778a853c4089'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:26.950878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1350/2722] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:26 2022] DELETE /identity/v3/users/f8af4962ea1d4b65b28c778a853c4089 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:26.956096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:26.956387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:26.956666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:26.973766 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:26.974954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.032230 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1373/2723] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:27.042071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.043564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.104588 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e8dd-65e6-4dbd-9d30-dfbac2f44401 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.108383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.110711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.111030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.111322 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.117578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.118925 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.123372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.124831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe277936-c348-45ac-adb9-72b132602b57 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:27.131845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd6f0-f702-48ef-aac6-e10c34ea37d6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.134692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1351/2724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:27.136688 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.137595 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.137876 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.138150 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] PATH_INFO: `/v3/users/962f24d763a44e41985dee5944334dcb` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.139367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962f24d763a44e41985dee5944334dcb)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.141470 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:27.367144 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962f24d763a44e41985dee5944334dcb'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.367867 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962f24d763a44e41985dee5944334dcb'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.368478 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962f24d763a44e41985dee5944334dcb'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.467820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962f24d763a44e41985dee5944334dcb'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.480261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962f24d763a44e41985dee5944334dcb'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.491941 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1374/2725] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:27 2022] DELETE /identity/v3/users/962f24d763a44e41985dee5944334dcb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:27.496510 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.496803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.497082 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.514538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:27.515747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.567825 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.569410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.572675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1352/2726] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:27.583560 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.583858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808ca6-cede-4bd1-9d33-40a6cfdadef9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.585483 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.588658 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.589706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.589962 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.590302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] PATH_INFO: `/v3/projects/0a8c0a8d98e647eb9e2f4f29108b2161` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.591633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8c0a8d98e647eb9e2f4f29108b2161)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.593650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:27.643994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f67db-6f54-4ffe-be01-78851e65c88c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.647648 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.648292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.648586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.648868 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.657697 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.659127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb3d8-3dd6-41d0-ab84-17beb1a17af3 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:27.668348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1353/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:27.696604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8c0a8d98e647eb9e2f4f29108b2161', 'request_id': 'req-931dc99e-8088-49d3-b944-318b38248983'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.759248 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8c0a8d98e647eb9e2f4f29108b2161', 'request_id': 'req-931dc99e-8088-49d3-b944-318b38248983'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.765703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8c0a8d98e647eb9e2f4f29108b2161', 'request_id': 'req-931dc99e-8088-49d3-b944-318b38248983'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.776183 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] The token cache is being invalidate because project 0a8c0a8d98e647eb9e2f4f29108b2161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:27.776469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.777106 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-931dc99e-8088-49d3-b944-318b38248983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:27.778635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1375/2728] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:27 2022] DELETE /identity/v3/projects/0a8c0a8d98e647eb9e2f4f29108b2161 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:27.783524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.783842 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.784153 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.801621 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:27.802822 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.864785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1354/2729] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:27.872752 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.873265 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.873790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.895640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:27.896960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:27.905429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1376/2730] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:27.909672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.919215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394ca3e-1999-4b97-a540-e12f4b1c8ac2 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.925332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.926003 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.926288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.926570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.927298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:27.927786 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.929436 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:27.942298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1355/2731] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:27.946583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:27.955809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11812ae-173e-46e6-ae2b-5e7bf15eefc5 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:27.960617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:27.961261 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:27.961540 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:27.961813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:27.962491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:27.964437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.047917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1377/2732] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:27 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:28.051998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.061791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9833-6679-4b3d-999c-047d44479bb3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.064806 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.066835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:28.119921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.120795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.121187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.121534 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.122318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.124437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.143437 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c21488-9a65-447b-85b8-2d7d814559cd admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.148223 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.149087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.149371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.149649 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] PATH_INFO: `/v3/projects/1e4ff8ae79d04c8aaa0b36ca94ebc456` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.150840 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4ff8ae79d04c8aaa0b36ca94ebc456)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.152804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.199890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1356/2733] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:28.203922 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.213533 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb4fe6-2036-417c-a252-6eda29c52dff admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.219936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.219936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.219936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.220231 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.220881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.222518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.233470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1357/2734] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:28.237835 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.247228 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd97144-191a-44f2-8519-2671b64dbf80 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.256408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4ff8ae79d04c8aaa0b36ca94ebc456', 'request_id': 'req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:28.305142 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.305807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.306093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.306368 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.307088 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.308721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.319233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1358/2735] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:28.323219 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.325466 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4ff8ae79d04c8aaa0b36ca94ebc456', 'request_id': 'req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:28.332020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4ff8ae79d04c8aaa0b36ca94ebc456', 'request_id': 'req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:28.332810 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcb66-21e3-4e3b-96f6-289b853306a0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.338212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.340387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.340387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.340387 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] PATH_INFO: `/v3/projects/47f880c9b6734347b5f6b244713373af/users/1da753507bcd489fbf7398e137e23fe4/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.343377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] The token cache is being invalidate because project 1e4ff8ae79d04c8aaa0b36ca94ebc456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:28.343711 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:28.344970 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ce5f2be3-e4c0-4825-b9ff-9c0e5f5dbcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:28.346529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1378/2736] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:28 2022] DELETE /identity/v3/projects/1e4ff8ae79d04c8aaa0b36ca94ebc456 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:28.351458 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23678b80-f286-43ee-ae94-fb1456c3a64a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.351774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23678b80-f286-43ee-ae94-fb1456c3a64a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.352050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23678b80-f286-43ee-ae94-fb1456c3a64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.356793 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f880c9b6734347b5f6b244713373af, user_id=1da753507bcd489fbf7398e137e23fe4, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.359544 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be1e8-c245-488d-a833-6be982bc432c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.371838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-23678b80-f286-43ee-ae94-fb1456c3a64a None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:28.373039 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-23678b80-f286-43ee-ae94-fb1456c3a64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:28.387984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1379/2737] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:28.389379 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.389668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.389943 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.409356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:28.410541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:28.418631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1380/2738] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:28.423718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.433136 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fe885-b298-44af-a0e0-8ed425949fa1 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.438474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1359/2739] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:28 2022] PUT /identity/v3/projects/47f880c9b6734347b5f6b244713373af/users/1da753507bcd489fbf7398e137e23fe4/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:28.448174 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.448464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.448753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.477200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] MFA Rules not processed for user `1da753507bcd489fbf7398e137e23fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:28.478592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:28.495005 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.495679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.495969 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.496246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.496968 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:28.497285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.498897 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.515108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1381/2740] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:11:28.519164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.528741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270dce-2180-4422-afe4-bd6d72410cee admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.533885 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.534522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.534807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.535082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.535797 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.537820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.542879 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1360/2741] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:28.554357 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.555777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:28.614388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845447bd-043b-4480-9a0a-8643b961a986 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.618077 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.618726 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.619016 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.619297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.628438 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1382/2742] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:28.629257 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.629441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.629730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.639398 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1361/2743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:11:28.690760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e04549-db0c-46df-950b-aa03613c3afb admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.695640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.696317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.696604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.696888 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.697698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.699666 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.810956 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1383/2744] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:28 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:28.814975 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.825440 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93f4e6-0a61-438e-bc1e-f359b89684f2 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.830477 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.831155 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.831463 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.832719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.832719 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.834101 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.843914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1362/2745] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:28.848439 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.858574 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a705-99c1-4abb-ad73-aa9eda2ac46a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.863129 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.863809 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.864119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.864468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.865164 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.866740 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ea3-1623-4620-be1a-f1cb68daba5a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.876387 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1384/2746] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:28.880566 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:28.890407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d71f-3c0d-4f6c-8165-f5a8ac1e3f32 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:28.895538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:28.896407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:28.896686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:28.896959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] PATH_INFO: `/v3/projects/e29a92433f8c42e5b684ed0598f61290/users/e8b4d3d26b014c9084dc0846c0ede85d/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:28.911753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29a92433f8c42e5b684ed0598f61290, user_id=e8b4d3d26b014c9084dc0846c0ede85d, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:28.914487 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:28.994008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1363/2747] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:28 2022] PUT /identity/v3/projects/e29a92433f8c42e5b684ed0598f61290/users/e8b4d3d26b014c9084dc0846c0ede85d/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:29.005111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:29.005407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:29.005689 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:29.032479 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] MFA Rules not processed for user `e8b4d3d26b014c9084dc0846c0ede85d`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:29.033747 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:29.096198 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1385/2748] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:29.107229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:29.108951 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:29.164986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450533a-2d08-4009-92fa-bd72dabdcad3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:29.168801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:29.169524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:29.169807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:29.170348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:29.178945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:29.180407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a353108-9383-4d58-88a5-a35ac009be3b service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:29.189819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1364/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:11:38.350898 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:38.352336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:38.419181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5dd47-f855-4d77-aa16-6258ef5147f2 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:38.424843 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:38.425707 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:38.425984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:38.426254 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] PATH_INFO: `/v3/users/1da753507bcd489fbf7398e137e23fe4` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:38.427454 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da753507bcd489fbf7398e137e23fe4)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:38.429490 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:38.605211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da753507bcd489fbf7398e137e23fe4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:38.605874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da753507bcd489fbf7398e137e23fe4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:38.606481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da753507bcd489fbf7398e137e23fe4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:38.689939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da753507bcd489fbf7398e137e23fe4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:38.702302 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da753507bcd489fbf7398e137e23fe4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:38.714345 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1386/2750] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:38 2022] DELETE /identity/v3/users/1da753507bcd489fbf7398e137e23fe4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:38.718803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:38.719293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:38.719393 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:38.736165 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:38.737343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:38.793932 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1365/2751] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:38.804717 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:38.806117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:38.864833 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6e7c2-e037-4efb-bc8f-0f74a2d91351 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:38.868556 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:38.869199 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:38.869480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:38.869753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:38.879159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:38.880625 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910cca-1a20-4fff-9df6-fd550a08564d service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:38.890134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1387/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:39.280721 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:39.285505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:39.295053 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8e5b-e781-4486-8045-b955d67b2be4 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:39.299963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:39.300823 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.301478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.301478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] PATH_INFO: `/v3/projects/47f880c9b6734347b5f6b244713373af` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.302561 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f880c9b6734347b5f6b244713373af)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:39.304531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:39.415541 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f880c9b6734347b5f6b244713373af', 'request_id': 'req-7d20c042-f162-4569-9f21-3f2006fd79ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:39.507456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f880c9b6734347b5f6b244713373af', 'request_id': 'req-7d20c042-f162-4569-9f21-3f2006fd79ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:39.513305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f880c9b6734347b5f6b244713373af', 'request_id': 'req-7d20c042-f162-4569-9f21-3f2006fd79ca'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:39.524602 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] The token cache is being invalidate because project 47f880c9b6734347b5f6b244713373af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:39.524892 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:39.525520 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-7d20c042-f162-4569-9f21-3f2006fd79ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:39.527055 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1366/2753] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:39 2022] DELETE /identity/v3/projects/47f880c9b6734347b5f6b244713373af => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:39.531940 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.532446 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.532560 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.550370 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:39.551617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:39.607816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1388/2754] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:39.615756 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.616052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.616336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.634863 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:39.636225 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:39.644210 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1367/2755] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:39.649093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:39.658631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb2960-5a5a-4a7c-afb1-f8b177efe451 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:39.663260 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:39.663939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.664220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.664494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.665231 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:39.665535 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:39.672012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:39.686289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1389/2756] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:39.687446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:39.700924 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3b29f-b2d3-478b-9416-3ccbe3cd6a98 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:39.702338 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:39.702991 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.703279 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.703668 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.704336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:39.706309 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:39.829033 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1368/2757] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:39 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:39.833286 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:39.843064 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d856a-121b-4f94-8889-1bd2a042a260 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:39.896464 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:39.897181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:39.897480 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:39.897889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:39.898613 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:39.900699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:39.994350 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1390/2758] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:39 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:40.002753 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:40.013575 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f457-97c3-4c23-aae0-50315b32e4a0 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:40.018389 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:40.023123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.023123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.023123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.023123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:40.023123 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:40.033022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1369/2759] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:40.037012 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:40.047123 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e3bb3-88d0-4da0-abcd-c23786f50a40 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:40.052573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:40.053293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.053703 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.053984 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.054702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:40.056512 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073170fe-94a4-4745-b9e5-f2b32dbbaafc admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:40.066481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1391/2760] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:40.071371 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:40.081104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f61d2-1eb1-46a1-ad63-27b1999378e4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:40.085914 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:40.086782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.087072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.087348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] PATH_INFO: `/v3/projects/1a9a68bda9714c41802a700e3546ed2b/users/8ab967a0088949e391c1888cca95bf04/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.101927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9a68bda9714c41802a700e3546ed2b, user_id=8ab967a0088949e391c1888cca95bf04, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:40.104624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:40.182579 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1370/2761] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:40 2022] PUT /identity/v3/projects/1a9a68bda9714c41802a700e3546ed2b/users/8ab967a0088949e391c1888cca95bf04/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:40.187725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.188017 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.188296 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.206204 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:40.207341 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:40.263117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1392/2762] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:40.272615 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:40.274298 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:40.329363 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fd67-0a92-45ac-b7ef-be018990ee64 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:40.332960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:40.333603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.333889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.334176 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.343078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:40.344548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d438f-0edd-42f8-b6ba-c3bed124053b service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:40.354374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1371/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:40.746484 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:40.748681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:40.760410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1dc61-332c-4017-8438-c80e12d97992 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:40.765006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:40.765957 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:40.766300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:40.766582 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] PATH_INFO: `/v3/users/e8b4d3d26b014c9084dc0846c0ede85d` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:40.771398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b4d3d26b014c9084dc0846c0ede85d)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:40.771398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:40.950726 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b4d3d26b014c9084dc0846c0ede85d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:40.951386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b4d3d26b014c9084dc0846c0ede85d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:40.952168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b4d3d26b014c9084dc0846c0ede85d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.016486 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b4d3d26b014c9084dc0846c0ede85d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.028954 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b4d3d26b014c9084dc0846c0ede85d'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.040899 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1393/2764] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:40 2022] DELETE /identity/v3/users/e8b4d3d26b014c9084dc0846c0ede85d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:41.045367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:41.045826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:41.045949 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:41.062471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:41.063736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:41.122480 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1372/2765] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:41.132830 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:41.134226 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:41.190414 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772fc91-77d6-4197-94c5-37a9919cdbc6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:41.195169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:41.195849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:41.196133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:41.196410 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:41.205588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:41.207190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76180-1ed4-49a6-8495-cf1ec64ab6e2 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:41.218267 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1394/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:41.663819 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:41.669994 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:41.687891 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a290-d3b4-40c1-847f-d8106c403929 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:41.693748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:41.694801 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:41.695248 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:41.695717 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] PATH_INFO: `/v3/projects/e29a92433f8c42e5b684ed0598f61290` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:41.697093 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29a92433f8c42e5b684ed0598f61290)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:41.699341 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:41.811755 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29a92433f8c42e5b684ed0598f61290', 'request_id': 'req-605c695c-f122-46bf-a94b-f9a1ed63ab12'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.885167 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29a92433f8c42e5b684ed0598f61290', 'request_id': 'req-605c695c-f122-46bf-a94b-f9a1ed63ab12'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.892681 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29a92433f8c42e5b684ed0598f61290', 'request_id': 'req-605c695c-f122-46bf-a94b-f9a1ed63ab12'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.905182 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] The token cache is being invalidate because project e29a92433f8c42e5b684ed0598f61290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:41.905626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.906683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-605c695c-f122-46bf-a94b-f9a1ed63ab12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:41.908692 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1373/2767] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:41 2022] DELETE /identity/v3/projects/e29a92433f8c42e5b684ed0598f61290 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:41.913771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:41.914694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:41.915157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:41.935939 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:41.937162 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:42.007646 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1395/2768] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:42.014126 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.015001 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.015336 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.037042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:42.038511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:42.047442 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1374/2769] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:42.052287 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.067011 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e44a3-e8d6-4172-a9d7-218ce6046a18 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.072369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.073158 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.073523 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.073837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.074793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:42.075200 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.076942 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.089702 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1396/2770] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:42.094232 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.104229 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ebba7-f427-4b2b-b31b-ddea633c1852 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.109837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.110585 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.111067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.111409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.112205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.114762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.230395 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1375/2771] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:42.234221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.244449 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378bc38-7783-4423-8371-a840d2c8c45f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.325852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.326531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.326811 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.327083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.327852 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.329847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.417819 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1397/2772] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:42.421777 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.453038 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3520-12de-4a3f-977f-21a35aa40119 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.458696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.460273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.460711 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.461158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.462423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.465894 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.480688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1376/2773] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:42.484627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.499818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7605-2bf0-4141-8521-458ca808c490 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.505398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.506288 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.506642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.506981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.507818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.509518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ca87-30e5-429f-8ec1-227d7e7ca6d2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.521608 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1398/2774] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:42.525039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.535548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f869575-d1c9-48e4-a388-853221e6fa2b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.542089 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.542987 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.543453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.543769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] PATH_INFO: `/v3/projects/43f3b8bd911946ec9af7cfc447be3b69/users/4db4c17ee413438fb2851ecbce5671cf/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.562696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f3b8bd911946ec9af7cfc447be3b69, user_id=4db4c17ee413438fb2851ecbce5671cf, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.565826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.628525 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1377/2775] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:42 2022] PUT /identity/v3/projects/43f3b8bd911946ec9af7cfc447be3b69/users/4db4c17ee413438fb2851ecbce5671cf/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:42.639589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.639887 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.640172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.666545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] MFA Rules not processed for user `4db4c17ee413438fb2851ecbce5671cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:42.667845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:42.734877 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1399/2776] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:42.739696 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.800878 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f024ef-f715-4b19-a5cd-44d293c9ff8f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.807869 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.811826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.811826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.811826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.811826 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.813002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:42.905308 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1378/2777] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:42.905459 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:42.915518 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173a0b0-ef75-497b-9701-bd1ea18b33af None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:42.988194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:42.989692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:42.990116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:42.990559 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:42.991417 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:42.993892 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.097317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1400/2778] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:42 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:43.101986 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.112858 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4d12-9b62-4eb8-ae74-2d59d3ee1b7c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.118603 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.119311 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.119630 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.119925 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.120683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.122524 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.138107 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1379/2779] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:43.139628 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.149820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577491-049a-42ec-925f-59218fb02923 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.154804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.155893 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.156300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.156686 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] PATH_INFO: `/v3/projects/131045dab96f4034b5e6df2fbe2f311b/users/060e7f2018174e76a426022530012ee6/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.185119 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] RBAC: Authorizing `identity:create_grant(project_id=131045dab96f4034b5e6df2fbe2f311b, user_id=060e7f2018174e76a426022530012ee6, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.188110 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.257135 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1401/2780] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:43 2022] PUT /identity/v3/projects/131045dab96f4034b5e6df2fbe2f311b/users/060e7f2018174e76a426022530012ee6/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:43.261178 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.271024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493176-de43-4786-80dc-e149dc8feb7f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.331943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.332535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.332857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.333135 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.333871 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.335694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06b7f-978f-470f-a1fc-6dd112d45a50 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.347847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1380/2781] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:43.352125 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.366363 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33c844-9319-464a-8d7b-4eb660c7158e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.371238 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.372228 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.372589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.372959 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] PATH_INFO: `/v3/projects/131045dab96f4034b5e6df2fbe2f311b/users/060e7f2018174e76a426022530012ee6/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.375062 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131045dab96f4034b5e6df2fbe2f311b, user_id=060e7f2018174e76a426022530012ee6, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.377872 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.389060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1402/2782] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:43 2022] PUT /identity/v3/projects/131045dab96f4034b5e6df2fbe2f311b/users/060e7f2018174e76a426022530012ee6/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:43.399580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.399877 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.400156 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.434042 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] MFA Rules not processed for user `060e7f2018174e76a426022530012ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:43.435430 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:43.515550 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1381/2783] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:43.527180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.528838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:43.592803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ccb65-c75a-4602-baf8-98a03614e7e6 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.597274 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.598197 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.599323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.599837 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.609980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.611452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384e3ab-c07c-44f1-b56d-d50f72a7bb38 service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.622019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1403/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:43.732381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:43.733898 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:43.747187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41fad2-f768-400b-8e99-6e522f96c7c3 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:43.751983 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:43.752636 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:43.752929 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:43.753205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:43.816613 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:43.818297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:43.827899 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1382/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:45.659693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:45.660693 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:45.661746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:45.699295 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] MFA Rules not processed for user `8ab967a0088949e391c1888cca95bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:45.700934 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:45.772343 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1404/2786] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:45.776780 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:45.778317 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:45.854640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44b85-1fc6-40c8-b45f-f387d26f5c91 service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:45.859272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:45.859968 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:45.860251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:45.860693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:45.861394 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:45.863304 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:45.982059 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1383/2787] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:45 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:45.983700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:45.995699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78164578-9aa6-480c-8862-c645bdfb7ffc None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:46.055375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:46.056086 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:46.056371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:46.056642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:46.057368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:46.059298 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:46.177713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1405/2788] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:45 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:46.181893 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:46.192672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4873-c8f4-492f-b0e2-1d96aff4af90 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:46.197348 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:46.198017 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:46.198297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:46.198570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:46.199288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:46.200927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:46.212683 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1384/2789] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:46.216929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:46.228191 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac13515-e59a-4a3e-bea4-6fc8c24522fb admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:46.232919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:46.233804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:46.234089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:46.234367 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] PATH_INFO: `/v3/projects/ddfff770e68c4084a0160301360b4bb5/users/2393578e2be442bbb92a7740a34a216e/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:46.250860 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfff770e68c4084a0160301360b4bb5, user_id=2393578e2be442bbb92a7740a34a216e, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:46.253721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:46.347537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1406/2790] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:46 2022] PUT /identity/v3/projects/ddfff770e68c4084a0160301360b4bb5/users/2393578e2be442bbb92a7740a34a216e/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:46.351488 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:46.361518 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c85c99-3baf-46d0-a67e-c2bd22116062 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:46.416552 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:46.417220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:46.417505 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:46.417782 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:46.418504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:46.420408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:46.429971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1385/2791] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:46.434292 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:46.447793 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098049-2709-4835-8b20-388a01c01fe7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:46.450278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:46.451157 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:46.451444 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:46.451790 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] PATH_INFO: `/v3/projects/ddfff770e68c4084a0160301360b4bb5/users/2393578e2be442bbb92a7740a34a216e/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:46.453813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfff770e68c4084a0160301360b4bb5, user_id=2393578e2be442bbb92a7740a34a216e, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:46.456547 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa087419-fef0-4665-a6be-1a38492b6a5d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:46.468289 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1407/2792] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:46 2022] PUT /identity/v3/projects/ddfff770e68c4084a0160301360b4bb5/users/2393578e2be442bbb92a7740a34a216e/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:48.645808 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:48.656449 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f61ad0-7fd7-4ca3-bf3a-3c3172e53469 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:48.757704 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:48.758940 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:48.759408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:48.759945 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] PATH_INFO: `/v3/users/4db4c17ee413438fb2851ecbce5671cf` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:48.762008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db4c17ee413438fb2851ecbce5671cf)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:48.764233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:48.961220 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db4c17ee413438fb2851ecbce5671cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:48.961570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db4c17ee413438fb2851ecbce5671cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:48.962343 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db4c17ee413438fb2851ecbce5671cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:49.028275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db4c17ee413438fb2851ecbce5671cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:49.037456 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db4c17ee413438fb2851ecbce5671cf'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:49.063034 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1386/2793] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:48 2022] DELETE /identity/v3/users/4db4c17ee413438fb2851ecbce5671cf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:49.064804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:49.068057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:49.068057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:49.087065 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:49.088623 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:49.175805 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1408/2794] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:49.183890 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:49.186026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:49.318865 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632b84-20ce-488b-b56c-c6897d8144c4 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:49.323374 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:49.352273 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:49.352567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:49.352850 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:49.370131 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:49.371770 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:49.382656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1387/2795] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:49.857297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:49.858900 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:49.883563 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ba962-40e4-400b-9f48-acdd1a6854c6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:49.896761 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:49.897650 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:49.897935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:49.898215 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] PATH_INFO: `/v3/projects/43f3b8bd911946ec9af7cfc447be3b69` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:49.899432 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f3b8bd911946ec9af7cfc447be3b69)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:49.901395 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:50.049901 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f3b8bd911946ec9af7cfc447be3b69', 'request_id': 'req-22931e58-ca0f-464d-8344-05218a8a746e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.113990 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f3b8bd911946ec9af7cfc447be3b69', 'request_id': 'req-22931e58-ca0f-464d-8344-05218a8a746e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.121622 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f3b8bd911946ec9af7cfc447be3b69', 'request_id': 'req-22931e58-ca0f-464d-8344-05218a8a746e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.134685 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] The token cache is being invalidate because project 43f3b8bd911946ec9af7cfc447be3b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:50.134966 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.135712 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.137382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1409/2796] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:49 2022] DELETE /identity/v3/projects/43f3b8bd911946ec9af7cfc447be3b69 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:50.141358 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:50.152040 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450c2c-2806-43f6-9340-46c91f2e7550 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:50.217620 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:50.218638 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:50.218988 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:50.219332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] PATH_INFO: `/v3/users/060e7f2018174e76a426022530012ee6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:50.220804 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060e7f2018174e76a426022530012ee6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:50.222942 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:50.378323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060e7f2018174e76a426022530012ee6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.379052 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060e7f2018174e76a426022530012ee6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.380283 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060e7f2018174e76a426022530012ee6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.456752 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060e7f2018174e76a426022530012ee6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.464417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-57692b1f-b2da-43e1-8552-998148834cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060e7f2018174e76a426022530012ee6'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:50.486209 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1388/2797] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:50 2022] DELETE /identity/v3/users/060e7f2018174e76a426022530012ee6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:50.960841 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:50.962668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:50.978627 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22931e58-ca0f-464d-8344-05218a8a746e admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.047398 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.048425 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.048713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.048988 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] PATH_INFO: `/v3/projects/131045dab96f4034b5e6df2fbe2f311b` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.050327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131045dab96f4034b5e6df2fbe2f311b)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.052679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.190227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131045dab96f4034b5e6df2fbe2f311b', 'request_id': 'req-11c968c7-15da-4d7b-a1ba-ac0995628342'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:51.262237 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131045dab96f4034b5e6df2fbe2f311b', 'request_id': 'req-11c968c7-15da-4d7b-a1ba-ac0995628342'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:51.269357 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131045dab96f4034b5e6df2fbe2f311b', 'request_id': 'req-11c968c7-15da-4d7b-a1ba-ac0995628342'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:51.280674 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] The token cache is being invalidate because project 131045dab96f4034b5e6df2fbe2f311b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79575) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:51.280963 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:51.281617 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-11c968c7-15da-4d7b-a1ba-ac0995628342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:51.283182 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1410/2798] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:50 2022] DELETE /identity/v3/projects/131045dab96f4034b5e6df2fbe2f311b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:51.289067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.289597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.289708 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.308927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:51.310151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:51.384372 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1389/2799] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:51.386645 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.386935 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.387212 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.413537 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:51.415889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:51.429889 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1411/2800] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:51.434504 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.445312 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987a27b-5a57-4bcf-9946-ff1574067161 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.450474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.451020 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.451300 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.451618 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.452352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:51.452659 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.454275 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.468787 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1390/2801] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:51.473278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.484529 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44170913-3625-4d12-9e19-ff6088330fa6 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.489581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.490244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.492709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.492709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.492709 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.493706 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.622832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1412/2802] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:51.626998 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.637772 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3416c7-0722-446f-b625-40ef372ecd27 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.704216 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.705285 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.706035 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.706535 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.707460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.710435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.810758 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1391/2803] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:51 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:51.815960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.826983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7198-7f8f-4959-969a-7a2426f8d61f admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.833867 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.834820 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.835300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.835882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.837285 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.839278 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.850946 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1413/2804] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:51.854824 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.865737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84e79f-73eb-4133-b10d-c5997277f061 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.870626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.871383 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.871680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.872041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.872649 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.874267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52295aca-982d-4bb6-b656-64a87527f1a6 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.885450 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1392/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:51.889607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:51.900612 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14b7df-f58c-4af8-8fcc-d74bb8cf1e47 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:51.905322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:51.906209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.906631 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.906756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] PATH_INFO: `/v3/projects/1966c70ccd254902ac479645db0d2506/users/95247bea6d9343359e15c07e21fe88e4/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:51.924720 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1966c70ccd254902ac479645db0d2506, user_id=95247bea6d9343359e15c07e21fe88e4, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:51.928096 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:51.984111 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1414/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:51 2022] PUT /identity/v3/projects/1966c70ccd254902ac479645db0d2506/users/95247bea6d9343359e15c07e21fe88e4/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:51.995096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb8c-312b-4b50-9cb8-4dccfb51c514 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:51.995417 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb8c-312b-4b50-9cb8-4dccfb51c514 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:51.995714 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb8c-312b-4b50-9cb8-4dccfb51c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.025132 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-b4f1cb8c-312b-4b50-9cb8-4dccfb51c514 None None] MFA Rules not processed for user `95247bea6d9343359e15c07e21fe88e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:52.026567 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b4f1cb8c-312b-4b50-9cb8-4dccfb51c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.098058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1393/2807] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:52.102952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.197317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750d18-670a-42cd-9fa0-244bd7702cc1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.204630 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.205600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.206168 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.206653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.207640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.209960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.347329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.351369 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1415/2808] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:52 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:52.352122 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.352294 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.352800 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.381792 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] MFA Rules not processed for user `2393578e2be442bbb92a7740a34a216e`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:52.383262 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.430981 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5595f-78fd-4e01-81a4-a77ba4e712d5 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.436371 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.439850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.439850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.439850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.439850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.441133 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.466268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1394/2809] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:52.489365 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.491191 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.534468 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1416/2810] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:52 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:52.538822 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.554541 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6d366-40e0-4ffd-8937-59ed1f564da4 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.560848 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.561532 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.561824 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.562104 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.562838 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.564662 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.566979 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1df0f-94a6-41f2-ae92-69244870a549 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.571785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d34ef4b64a42a897fa75e8b14c60f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.572492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.572781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.573057 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.574996 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.578597 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1417/2811] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:52.579588 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.592846 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a220335-8774-4040-9428-0a17804673e9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.597698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.599155 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.599441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.599778 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] PATH_INFO: `/v3/projects/7c6c719d6b8d41c79b06a71af81acf01/users/d7c6bf4a842d44afb62bf7cc50a54a52/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.616570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6c719d6b8d41c79b06a71af81acf01, user_id=d7c6bf4a842d44afb62bf7cc50a54a52, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.619306 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.639845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.641318 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.651292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1395/2812] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:11:52.702845 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1418/2813] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:52 2022] PUT /identity/v3/projects/7c6c719d6b8d41c79b06a71af81acf01/users/d7c6bf4a842d44afb62bf7cc50a54a52/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:52.706981 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.718847 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca42e-5b2c-4ebd-9f58-89d9eb1eb2eb service glance] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.782264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.782952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.783271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.783592 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.784331 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.786556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786214d-ef41-42fa-acf9-f8c42125c337 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.800965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1396/2814] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:52.802297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:52.814575 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a276-f3dc-44b8-a2ba-1d5b9ff86e59 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:52.820050 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:52.821058 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] REQUEST_METHOD: `PUT` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.821448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.821832 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] PATH_INFO: `/v3/projects/7c6c719d6b8d41c79b06a71af81acf01/users/d7c6bf4a842d44afb62bf7cc50a54a52/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.824549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6c719d6b8d41c79b06a71af81acf01, user_id=d7c6bf4a842d44afb62bf7cc50a54a52, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:52.827618 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092e3d-a1f2-405f-8e73-634e7b984881 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:52.840714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1419/2815] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:52 2022] PUT /identity/v3/projects/7c6c719d6b8d41c79b06a71af81acf01/users/d7c6bf4a842d44afb62bf7cc50a54a52/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:52.852346 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.852637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.852916 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.882934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] MFA Rules not processed for user `d7c6bf4a842d44afb62bf7cc50a54a52`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:52.884239 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.964140 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:52.964461 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:52.964788 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:52.976557 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1397/2816] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:52.984642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:52.985919 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:52.999012 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:53.000881 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:53.054980 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1420/2817] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:53.062818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96c8d6-d674-40ae-8530-e08cb61292b8 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:53.073206 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:53.074008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:53.074364 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:53.074712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:53.086296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:53.088243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:53.098740 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1398/2818] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:11:53.127090 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:53.193605 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4c63-e084-40b9-845c-4556c6c1f53c None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:53.195356 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:53.196257 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:53.196538 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:53.196813 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] PATH_INFO: `/v3/users/95247bea6d9343359e15c07e21fe88e4` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:53.198109 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95247bea6d9343359e15c07e21fe88e4)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:53.200203 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:53.221061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:53.222446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:53.294215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10730bde-8376-48a3-89b0-94e60eea9e4d service cinder] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:53.300269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:53.300928 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:53.301737 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:53.302025 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:53.311106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:53.312749 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b99ef4-6430-469d-ae9a-c92a3d577b99 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:53.322678 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1399/2819] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 13:11:53.394098 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95247bea6d9343359e15c07e21fe88e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:53.395871 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95247bea6d9343359e15c07e21fe88e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:53.396804 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95247bea6d9343359e15c07e21fe88e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:53.496103 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95247bea6d9343359e15c07e21fe88e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:53.513850 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95247bea6d9343359e15c07e21fe88e4'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:53.527443 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1421/2820] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:53 2022] DELETE /identity/v3/users/95247bea6d9343359e15c07e21fe88e4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:53.532660 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:53.533116 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:53.533423 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:53.554379 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:53.555672 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:53.639439 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1400/2821] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 13:11:53.649505 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:53.651132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:53.715453 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a483b-a801-4a7d-9db7-04467a6a9915 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:53.721159 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:53.721890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:53.722323 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:53.722583 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:53.732759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:53.734249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:53.747361 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1422/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:54.201211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:54.202880 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:54.215971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd55c-9b77-48b6-bec1-c38ccae64a80 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:54.221514 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:54.222409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:54.222694 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:54.222972 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] PATH_INFO: `/v3/projects/1966c70ccd254902ac479645db0d2506` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:54.224784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1966c70ccd254902ac479645db0d2506)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:54.227500 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:54.341264 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1966c70ccd254902ac479645db0d2506', 'request_id': 'req-e4d91dd6-5beb-4568-9edd-18625f63777f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.410656 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1966c70ccd254902ac479645db0d2506', 'request_id': 'req-e4d91dd6-5beb-4568-9edd-18625f63777f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.416997 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1966c70ccd254902ac479645db0d2506', 'request_id': 'req-e4d91dd6-5beb-4568-9edd-18625f63777f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.430700 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] The token cache is being invalidate because project 1966c70ccd254902ac479645db0d2506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:54.431054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.431691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.433252 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1401/2823] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:54 2022] DELETE /identity/v3/projects/1966c70ccd254902ac479645db0d2506 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:54.437616 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:54.448491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fffb95-f26f-4d31-9691-ceea98e79c33 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:54.520664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:54.521447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:54.521722 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:54.522008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] PATH_INFO: `/v3/users/d7c6bf4a842d44afb62bf7cc50a54a52` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:54.523219 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c6bf4a842d44afb62bf7cc50a54a52)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:54.525205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:54.690393 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c6bf4a842d44afb62bf7cc50a54a52'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.691435 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c6bf4a842d44afb62bf7cc50a54a52'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.692653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c6bf4a842d44afb62bf7cc50a54a52'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.747567 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c6bf4a842d44afb62bf7cc50a54a52'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.763960 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-2a2a4dcd-5a58-4824-8beb-264f8388734c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c6bf4a842d44afb62bf7cc50a54a52'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:54.780152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1423/2824] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:54 2022] DELETE /identity/v3/users/d7c6bf4a842d44afb62bf7cc50a54a52 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:55.279271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:55.279271 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:55.308332 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d91dd6-5beb-4568-9edd-18625f63777f admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:55.389212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:55.390197 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:55.390543 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:55.390943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] PATH_INFO: `/v3/projects/7c6c719d6b8d41c79b06a71af81acf01` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:55.392428 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6c719d6b8d41c79b06a71af81acf01)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:55.394367 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:55.522215 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6c719d6b8d41c79b06a71af81acf01', 'request_id': 'req-b58ae684-7833-4057-a08a-5b1bf21c8cf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:55.593099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6c719d6b8d41c79b06a71af81acf01', 'request_id': 'req-b58ae684-7833-4057-a08a-5b1bf21c8cf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:55.602118 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6c719d6b8d41c79b06a71af81acf01', 'request_id': 'req-b58ae684-7833-4057-a08a-5b1bf21c8cf9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:55.614103 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] The token cache is being invalidate because project 7c6c719d6b8d41c79b06a71af81acf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:55.614470 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:55.615185 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b58ae684-7833-4057-a08a-5b1bf21c8cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:55.617105 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1402/2825] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:55 2022] DELETE /identity/v3/projects/7c6c719d6b8d41c79b06a71af81acf01 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:55.622592 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:55.623087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:55.623176 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:55.647463 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:55.648725 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:55.729929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1424/2826] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:55.737855 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:55.738144 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:55.738422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:55.760732 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:55.762128 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:55.771658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1403/2827] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:55.778020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:55.789201 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079a4f-316c-4fe4-888d-b607c00b9b4b None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:55.794028 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:55.795085 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:55.795492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:55.795882 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:55.796714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:55.797142 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:55.799117 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:55.814896 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1425/2828] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 13:11:55.818909 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:55.831151 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ba0e-75c2-4ffe-9318-fa314a742408 None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:55.837172 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:55.838071 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:55.838460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:55.838845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:55.841381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:55.843598 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:55.957425 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1404/2829] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:55 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 13:11:55.965018 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:55.976713 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5decb-de1f-4c08-9a34-e75a804af4b2 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:56.048710 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:56.049522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.049890 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.050317 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.051205 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:56.053349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:56.388581 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1426/2830] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:55 2022] POST /identity/v3/users => generated 287 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:56.392690 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:56.402693 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ca690-6551-4027-91b8-c15ea85f0232 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:56.407352 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:56.409591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.409591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.409591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.409591 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:56.411187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:56.421795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1405/2831] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:56.425794 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:56.437253 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed76a9-a051-477f-bded-1856ee539fd9 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:56.442665 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:56.443570 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.443784 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.444063 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.444803 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:56.446549 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb67ff-162f-40ef-a728-2ccdfc7f27ac admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:56.458445 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1427/2832] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:56.462471 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:56.475376 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6b71-258f-4708-bb8a-4e6ee9e040e3 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:56.480481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:56.481453 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.481809 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.482158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] PATH_INFO: `/v3/projects/f9458dd7a67043198f7f110db7f2c831/users/d12e49eedf7844779b01373a1a09f923/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.507781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9458dd7a67043198f7f110db7f2c831, user_id=d12e49eedf7844779b01373a1a09f923, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:56.510516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:56.589730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1406/2833] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:56 2022] PUT /identity/v3/projects/f9458dd7a67043198f7f110db7f2c831/users/d12e49eedf7844779b01373a1a09f923/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:56.600698 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.601247 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.601918 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.661469 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] MFA Rules not processed for user `d12e49eedf7844779b01373a1a09f923`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:56.663403 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:56.781799 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1428/2834] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:56.789927 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:56.792253 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:56.906564 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee01b73-8dfd-4102-9124-2f2d9e80881b admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:56.911208 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:56.911906 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:56.912241 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:56.912474 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:56.925685 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:56.928936 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0cd8-717c-4e73-99b8-21db23cf8354 service cinder] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:56.960437 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1407/2835] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:57.006906 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:57.123589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a9cf7-3d0e-422d-b6d5-5e2b87b48719 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:57.132907 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:57.134493 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:57.136116 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:57.141656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] PATH_INFO: `/v3/users/d12e49eedf7844779b01373a1a09f923` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:57.141656 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12e49eedf7844779b01373a1a09f923)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:57.146488 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:57.361664 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12e49eedf7844779b01373a1a09f923'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:57.362769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12e49eedf7844779b01373a1a09f923'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:57.363727 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12e49eedf7844779b01373a1a09f923'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:57.404821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12e49eedf7844779b01373a1a09f923'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:57.424093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12e49eedf7844779b01373a1a09f923'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:57.444115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1429/2836] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:11:57 2022] DELETE /identity/v3/users/d12e49eedf7844779b01373a1a09f923 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 13:11:57.446099 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:57.446607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:57.446691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:57.471818 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:57.473306 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:57.556284 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1408/2837] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:57.566450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:57.568679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:57.652235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bc6ac-d044-481b-86ab-ab1606e9b01a admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:57.657869 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:57.658751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:57.659047 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:57.659332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:57.675847 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:57.677291 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d2925-57e0-42c9-865e-8ecd69bd5d7e service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:57.690020 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1430/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:11:58.200604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:58.202272 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:58.227538 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592d0e7-8174-4f0b-82a5-da713022e48b None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:58.236323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:58.237200 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.237481 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.237764 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] PATH_INFO: `/v3/projects/f9458dd7a67043198f7f110db7f2c831` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.239616 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9458dd7a67043198f7f110db7f2c831)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:58.244873 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:58.334941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9458dd7a67043198f7f110db7f2c831', 'request_id': 'req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:58.387435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9458dd7a67043198f7f110db7f2c831', 'request_id': 'req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:58.394166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9458dd7a67043198f7f110db7f2c831', 'request_id': 'req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:58.410921 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] The token cache is being invalidate because project f9458dd7a67043198f7f110db7f2c831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:11:58.411593 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:58.412502 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-c66bcf80-fa26-461a-b265-4f0e9e4ac02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:11:58.414296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1409/2839] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:11:58 2022] DELETE /identity/v3/projects/f9458dd7a67043198f7f110db7f2c831 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:58.419823 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.420170 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.420508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.441115 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:58.442855 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:58.509548 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1431/2840] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:58.518435 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.518990 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.519078 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.538199 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:58.539433 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:58.548190 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1410/2841] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:58.552783 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:58.563300 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2271c-c5cd-4e52-a697-e62dd383f3fe None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:58.572249 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:58.572929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.573222 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.573509 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.574275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79575) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 13:11:58.574591 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:58.576277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:58.592697 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1432/2842] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Feb 28 13:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 13:11:58.597166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:58.609044 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0a905-5552-4e84-a2ba-9b27aafd9beb None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:58.615302 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:58.616187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.616624 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.617255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] PATH_INFO: `/v3/projects` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.617969 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:58.620186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:58.712587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1411/2843] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:11:58 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:58.716441 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:58.730149 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9158-50b0-4095-9fe9-a5c9cc021a6b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:58.836807 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:58.837492 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.837756 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.838042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.838738 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:58.841019 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:58.933508 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1433/2844] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:11:58 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:11:58.935070 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:58.954831 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444a60-1445-4f45-a6bb-d4018ddc1274 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:58.968856 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:58.969723 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:58.970611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:58.970611 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] PATH_INFO: `/v3/roles` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:58.971626 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:58.973657 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:59.001650 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1412/2845] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 13:11:59.007407 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:59.018864 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80ff1-5a80-41d6-a348-b312862f5dc1 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:59.024774 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:59.025452 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:59.025737 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:59.026022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:59.027668 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:59.029545 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585362-a81a-4eac-b273-b0704250a605 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:59.048548 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:59.050233 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1434/2846] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:11:59.067769 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d193f9-3fd7-4bea-b627-840b1b23e82c admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:59.096765 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:59.099943 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:59.100233 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:59.100517 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] PATH_INFO: `/v3/projects/b56a3f7798474e458c47e5471148680d/users/453b8bf4426a45ed8e2c9e05b133b713/roles/8f80caecbcc747418e3bf59033daf4ab` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:59.146813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56a3f7798474e458c47e5471148680d, user_id=453b8bf4426a45ed8e2c9e05b133b713, role_id=8f80caecbcc747418e3bf59033daf4ab)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:59.153288 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:59.252759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1413/2847] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:11:59 2022] PUT /identity/v3/projects/b56a3f7798474e458c47e5471148680d/users/453b8bf4426a45ed8e2c9e05b133b713/roles/8f80caecbcc747418e3bf59033daf4ab => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:11:59.257771 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce6d-5442-4a90-b48f-131c37739260 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:59.260165 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce6d-5442-4a90-b48f-131c37739260 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:59.260494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce6d-5442-4a90-b48f-131c37739260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:59.281534 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-ce17ce6d-5442-4a90-b48f-131c37739260 None None] MFA Rules not processed for user `ed54666ec9a44289bd042f58137716cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:11:59.287573 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ce17ce6d-5442-4a90-b48f-131c37739260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:59.361715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1435/2848] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:11:59.371565 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:11:59.373293 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:11:59.442841 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337fcf5-8068-4e0a-92fa-3b6f95e5ae43 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:11:59.446957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:11:59.447675 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:11:59.447971 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:11:59.448238 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:11:59.459633 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:11:59.460688 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691d48-2f26-4861-8441-1cdad4b2fe00 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:11:59.472429 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1414/2849] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:12:04.333327 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:04.333884 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:04.334083 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:04.352927 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] MFA Rules not processed for user `8ab967a0088949e391c1888cca95bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:12:04.354241 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:04.414684 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1436/2850] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:12:05.623166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:05.623680 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:05.623795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:05.678255 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] MFA Rules not processed for user `453b8bf4426a45ed8e2c9e05b133b713`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:12:05.679056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:05.749766 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1415/2851] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:12:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:12:05.751360 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:05.763746 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067bfd6-ab53-438f-81f2-38f5474bd0ac None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:05.769108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:05.769812 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:05.770100 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:05.770377 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:05.771108 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:05.773152 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:05.869759 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1437/2852] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Feb 28 13:12:05 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:12:05.873803 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:05.884815 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53cdf5-5c33-4a18-9346-26c803d1888f None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:05.942106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:05.943146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:05.943734 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:05.944235 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] PATH_INFO: `/v3/users` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:05.945146 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:05.947345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:06.016691 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1416/2853] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Feb 28 13:12:05 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 13:12:06.021431 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:06.032607 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b0c6-d26d-4bbd-b788-e86c480c9e43 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:06.038800 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:06.039495 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:06.043770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:06.043770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:06.043770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:06.043770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:06.054220 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1438/2854] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:12:06.058205 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:06.073106 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377d9d-3a9f-4da7-b9bb-38b8edd8e0ed admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:06.078061 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:06.078952 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:06.079261 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:06.079570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] PATH_INFO: `/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4/users/63ff223f75234ef8adf3b5708576a538/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:06.096045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb61bd6c27ed4551abd043d9c1f1c1d4, user_id=63ff223f75234ef8adf3b5708576a538, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:06.099345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:06.166754 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1417/2855] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:12:06 2022] PUT /identity/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4/users/63ff223f75234ef8adf3b5708576a538/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:12:06.170569 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:06.182320 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28a83-e9d3-49c1-8bfe-188d67a4e68b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:06.246424 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:06.247120 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:06.247408 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:06.247734 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:06.248481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:06.250087 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15598b-1749-4361-ae9e-14271310df1e admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:06.263745 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1439/2856] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Feb 28 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 13:12:06.265041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:06.275597 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0194-5883-4cef-b7cb-98de146b0bbd admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:06.280360 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:06.281244 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:06.281528 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:06.281807 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] PATH_INFO: `/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4/users/63ff223f75234ef8adf3b5708576a538/roles/02948fe3aa224688a909554882ca78f6` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:06.284047 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb61bd6c27ed4551abd043d9c1f1c1d4, user_id=63ff223f75234ef8adf3b5708576a538, role_id=02948fe3aa224688a909554882ca78f6)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:06.290889 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:06.299133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1418/2857] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Feb 28 13:12:06 2022] PUT /identity/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4/users/63ff223f75234ef8adf3b5708576a538/roles/02948fe3aa224688a909554882ca78f6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:12:08.211995 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6173d0-4a20-41ed-854f-ed09df1aeafc None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:08.213169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6173d0-4a20-41ed-854f-ed09df1aeafc None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:08.213282 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6173d0-4a20-41ed-854f-ed09df1aeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:08.232349 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-8c6173d0-4a20-41ed-854f-ed09df1aeafc None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:12:08.234402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-8c6173d0-4a20-41ed-854f-ed09df1aeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:08.326316 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1440/2858] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Feb 28 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:12:08.348748 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:08.352187 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:08.461249 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0f289-b121-4f76-b8a8-2ada5bdf7052 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:08.476658 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:08.478168 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:08.478531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:08.478965 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:08.513127 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:08.514950 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:08.526091 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1419/2859] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:12:14.856190 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aefea-aa60-4a73-b4c7-01efda5fb8b2 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:14.857034 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aefea-aa60-4a73-b4c7-01efda5fb8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:14.857467 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aefea-aa60-4a73-b4c7-01efda5fb8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:14.911700 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-a19aefea-aa60-4a73-b4c7-01efda5fb8b2 None None] MFA Rules not processed for user `63ff223f75234ef8adf3b5708576a538`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:12:14.913147 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-a19aefea-aa60-4a73-b4c7-01efda5fb8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:15.106821 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1441/2860] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:12:15.121074 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:15.123507 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:15.291334 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b233e13-39de-422a-b16d-ba78eb8ca073 service swift] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:15.305934 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:15.306604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:15.306888 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:15.307243 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:15.404054 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:15.406785 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:15.435446 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1420/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 13:12:35.999600 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:36.000202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:36.000202 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:36.017944 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] MFA Rules not processed for user `453b8bf4426a45ed8e2c9e05b133b713`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:12:36.019154 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:36.026132 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1442/2862] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:12:36.862580 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:36.865604 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:36.920845 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f858695-97d5-4e38-ad33-8bb47bdfb345 service nova] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:36.924586 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:36.925223 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:36.925516 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:36.925791 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:36.927570 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:36.989813 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:36.991268 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:37.001511 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1421/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:12:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:12:38.888714 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:12:38.890679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:38.907644 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5a49a-7962-4ba2-b11d-130a26ad33bf None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:12:38.913073 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:12:38.913733 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:12:38.914033 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:12:38.914309 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:12:38.916079 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:12:38.928633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:12:38.930236 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:12:38.941447 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1443/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:13:01.140056 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:13:01.148866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05371a-e169-49ed-8f00-fa620d85ba33 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:13:01.153109 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:13:01.153759 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:13:01.154058 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:13:01.154325 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:13:01.163024 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:13:01.164492 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:13:01.173941 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1422/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:13:55.703299 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:13:55.713368 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9424a9-8fe7-485c-97c9-a2f7f59b33d0 service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:13:55.716983 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:13:55.717633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:13:55.717917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:13:55.718194 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:13:55.719972 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:13:55.733589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:13:55.734999 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:13:55.746578 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1444/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:13:56.312039 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:13:56.327133 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248d351-2a91-4fd2-a766-a19850907d4b service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:13:56.332385 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:13:56.333063 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:13:56.333355 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:13:56.333637 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:13:56.335558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:13:56.346864 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:13:56.349130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:13:56.366959 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1423/2867] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:14:00.243692 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:00.245093 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:00.299206 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339ab0-db48-45d3-ab9b-24dc17858c3b service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:00.302795 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6793eba624e644a9ba49910428cdb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:00.303428 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:00.303749 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:00.304029 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:00.305741 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:00.318867 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:00.320318 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa025-85ca-4ad0-9688-bac4bbe0c1be service cinder] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:00.331169 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1445/2868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:14:04.966015 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:04.978795 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900a1f-581c-4939-bbc2-fee287409e74 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:04.984269 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:04.984903 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:04.985186 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:04.985460 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:04.987751 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:05.000177 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:05.005049 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:05.012796 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1424/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:14:06.724894 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:06.725342 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:06.725448 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:06.743436 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] MFA Rules not processed for user `83d400660fda46bb810dddd5c79ebdc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:14:06.744653 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:06.752022 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1446/2870] 10.222.0.23 () {58 vars in 967 bytes} [Mon Feb 28 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:14:06.792030 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:06.804412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf3ba-f859-478e-a01e-e2eccc74c5be service nova] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:06.809407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acf32cc208ae41bb83c0248bbcfe74a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:06.810041 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:06.810329 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:06.810607 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:06.818542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:06.820173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:06.827999 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1425/2871] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Feb 28 13:14:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 13:14:14.447718 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:14.449180 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:14.515858 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0427f-33db-4c8c-939f-49853729928a None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:14.516769 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:14.517633 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:14.517917 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:14.518193 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] PATH_INFO: `/v3/users/8ab967a0088949e391c1888cca95bf04` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:14.519376 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab967a0088949e391c1888cca95bf04)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:14.521332 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:14.688589 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab967a0088949e391c1888cca95bf04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:14.689181 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab967a0088949e391c1888cca95bf04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:14.690402 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab967a0088949e391c1888cca95bf04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:14.778328 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab967a0088949e391c1888cca95bf04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:14.789958 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab967a0088949e391c1888cca95bf04'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:14.802340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1447/2872] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:14:14 2022] DELETE /identity/v3/users/8ab967a0088949e391c1888cca95bf04 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:14:15.043299 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:15.054811 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e23c3e-b604-432e-9404-46242a3e9503 service swift] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:15.108741 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:15.109587 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:15.109867 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:15.110137 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] PATH_INFO: `/v3/projects/1a9a68bda9714c41802a700e3546ed2b` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:15.111297 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9a68bda9714c41802a700e3546ed2b)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:15.113806 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:15.211773 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9a68bda9714c41802a700e3546ed2b', 'request_id': 'req-89a699ce-633b-4f27-99b5-a827c5aa3ac9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.281305 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9a68bda9714c41802a700e3546ed2b', 'request_id': 'req-89a699ce-633b-4f27-99b5-a827c5aa3ac9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.287386 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9a68bda9714c41802a700e3546ed2b', 'request_id': 'req-89a699ce-633b-4f27-99b5-a827c5aa3ac9'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.298164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] The token cache is being invalidate because project 1a9a68bda9714c41802a700e3546ed2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:14:15.303013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.303013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.303013 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1426/2873] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:14:15 2022] DELETE /identity/v3/projects/1a9a68bda9714c41802a700e3546ed2b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:14:15.305221 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:15.306604 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:15.319386 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cba8c-4a06-4477-96f0-f43842c67b51 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:15.373141 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:15.374006 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:15.374322 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:15.374601 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] PATH_INFO: `/v3/users/2393578e2be442bbb92a7740a34a216e` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:15.375818 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2393578e2be442bbb92a7740a34a216e)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:15.377736 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:15.517004 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2393578e2be442bbb92a7740a34a216e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.518137 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2393578e2be442bbb92a7740a34a216e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.518680 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2393578e2be442bbb92a7740a34a216e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.578384 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2393578e2be442bbb92a7740a34a216e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.590715 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-0a9a4f96-9277-462e-b2ed-50458db0791d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2393578e2be442bbb92a7740a34a216e'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:15.602870 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1448/2874] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:14:15 2022] DELETE /identity/v3/users/2393578e2be442bbb92a7740a34a216e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:14:15.814730 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:14:15.816345 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:14:15.828839 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a699ce-633b-4f27-99b5-a827c5aa3ac9 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:14:15.884212 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:14:15.885072 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:14:15.885354 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:14:15.885627 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] PATH_INFO: `/v3/projects/ddfff770e68c4084a0160301360b4bb5` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:14:15.886779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfff770e68c4084a0160301360b4bb5)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:14:15.888736 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:14:15.995701 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfff770e68c4084a0160301360b4bb5', 'request_id': 'req-bdc9abad-eb03-4597-8749-e8f2977aabc8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:16.104104 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfff770e68c4084a0160301360b4bb5', 'request_id': 'req-bdc9abad-eb03-4597-8749-e8f2977aabc8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:16.109761 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfff770e68c4084a0160301360b4bb5', 'request_id': 'req-bdc9abad-eb03-4597-8749-e8f2977aabc8'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:16.121124 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] The token cache is being invalidate because project ddfff770e68c4084a0160301360b4bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:14:16.121408 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:16.122026 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:14:16.123762 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1427/2875] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:14:15 2022] DELETE /identity/v3/projects/ddfff770e68c4084a0160301360b4bb5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:15:04.380244 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] REQUEST_METHOD: `POST` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:15:04.381270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:15:04.381388 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:15:04.399227 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.auth.core [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] MFA Rules not processed for user `453b8bf4426a45ed8e2c9e05b133b713`. Rule list: `[]` (Enabled: `True`). {{(pid=79575) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:15:04.400472 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:04.452297 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1449/2876] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:15:04.753472 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:15:04.754857 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:04.813011 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9abad-eb03-4597-8749-e8f2977aabc8 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:15:04.816635 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:15:04.817276 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:15:04.817559 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:15:04.817837 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:15:04.820251 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:04.832478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:15:04.832478 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:15:04.839260 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1428/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:15:05.443209 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:15:05.444765 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:05.512865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11744c2d-ac3c-4598-a3c0-0b63933f9635 None None] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:15:05.517865 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:15:05.518513 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:15:05.518802 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:15:05.519082 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:15:05.520849 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:05.532481 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:15:05.534060 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:15:05.544770 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1450/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:15:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:15:20.956173 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:15:20.957558 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:21.029130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce9668-342a-43e8-8757-be72cfb57cb7 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:15:21.034784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:15:21.035267 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:15:21.035581 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:15:21.036412 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:15:21.038214 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:15:21.051108 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:15:21.053957 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385b7d-c1a0-4163-a1c4-21b09883a361 service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:15:21.063556 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1429/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:16:28.104705 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:16:28.106080 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:16:28.187922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623bc22-9b79-4ac9-a9fe-2e2a819c9222 service placement] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:16:28.193008 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:16:28.193640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:16:28.193922 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:16:28.194196 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:16:28.195976 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:16:28.208235 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:16:28.209801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:16:28.219394 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1451/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:16:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:17:09.226130 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] REQUEST_METHOD: `POST` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:17:09.226640 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:17:09.226757 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:17:09.244022 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.auth.core [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] MFA Rules not processed for user `453b8bf4426a45ed8e2c9e05b133b713`. Rule list: `[]` (Enabled: `True`). {{(pid=79576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 13:17:09.246277 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:17:09.252409 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1430/2881] 10.222.0.23 () {58 vars in 957 bytes} [Mon Feb 28 13:17:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 13:17:09.562762 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:17:09.581576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12edc9-37a0-4985-968a-301cdf426fa4 service placement] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:17:09.585258 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:17:09.585886 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:17:09.586172 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:17:09.586450 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:17:09.588192 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:17:09.609586 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:17:09.611003 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:17:09.619501 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1452/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:17:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:17:15.917747 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:17:15.947832 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b089-c832-46a4-96c2-feaeed592d2c None None] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:17:15.953291 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:17:15.953963 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:17:15.954247 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:17:15.954530 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:17:15.956323 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:17:15.966388 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:17:15.968008 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:17:15.976623 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1431/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:17:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:18:59.181772 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:18:59.183066 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:18:59.213173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b569-08da-4bc4-89b9-66d459d348d6 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:18:59.220836 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:18:59.221494 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:18:59.221780 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:18:59.222057 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:18:59.223914 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:18:59.236681 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:18:59.238272 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:18:59.249031 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1453/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:18:59.314258 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:18:59.315739 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:18:59.328926 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ef74-5b87-4a6f-b824-71619872883e service nova] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:18:59.332779 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:18:59.333422 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:18:59.333705 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:18:59.334164 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:18:59.336096 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:18:59.347102 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:18:59.348781 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:18:59.358583 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1432/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:18:59.571336 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:18:59.581998 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13fa8b-a1c9-4052-b708-a43d4024021a service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:18:59.586211 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:18:59.586929 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:18:59.587499 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:18:59.587874 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:18:59.589751 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:18:59.604955 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:18:59.606491 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:18:59.618699 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1454/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:19:00.810783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:00.820292 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa54e8-fee8-4657-8a07-cb031b74cdd4 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:00.824158 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:00.824866 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:00.825221 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:00.825562 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:00.827366 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:00.841531 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:00.842967 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:00.854718 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1433/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:19:07.498275 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:07.509721 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b923-8159-420a-9796-08c1228545d2 service neutron] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:07.516311 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ae9eb24d0a4617bb52c9680bc7a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:07.516952 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:07.517232 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:07.517657 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:07.520216 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:07.537694 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:07.539642 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:07.550704 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1455/2888] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:19:14.507303 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:14.515788 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694620f-4114-4e22-94ab-158b234d7f44 service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:14.519407 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac94b28422044aed9681b0c31b9ab97e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:14.520139 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] REQUEST_METHOD: `GET` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:14.520426 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:14.520703 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:14.522464 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:14.604043 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:14.605489 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:14.624381 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1434/2889] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 13:19:21.870134 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:21.871744 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:21.885873 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce04fb3-9432-44f6-9c0c-b7a1ac83c247 service nova] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:21.890382 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:21.891760 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:21.892070 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:21.892347 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] PATH_INFO: `/v3/users/453b8bf4426a45ed8e2c9e05b133b713` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:21.893522 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453b8bf4426a45ed8e2c9e05b133b713)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:21.895429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:22.070314 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453b8bf4426a45ed8e2c9e05b133b713'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.070967 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453b8bf4426a45ed8e2c9e05b133b713'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.071610 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453b8bf4426a45ed8e2c9e05b133b713'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.131277 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453b8bf4426a45ed8e2c9e05b133b713'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.143375 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453b8bf4426a45ed8e2c9e05b133b713'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.155173 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1456/2890] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:19:21 2022] DELETE /identity/v3/users/453b8bf4426a45ed8e2c9e05b133b713 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:19:22.401647 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:22.413784 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441104b-1296-4497-8a2a-572c2824758d service neutron] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:22.469542 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:22.470384 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:22.470662 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:22.470960 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] PATH_INFO: `/v3/projects/b56a3f7798474e458c47e5471148680d` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:22.472226 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56a3f7798474e458c47e5471148680d)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:22.474193 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:22.565817 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56a3f7798474e458c47e5471148680d', 'request_id': 'req-06a4c64d-8c44-4160-b903-0d95dcce1286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.628610 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56a3f7798474e458c47e5471148680d', 'request_id': 'req-06a4c64d-8c44-4160-b903-0d95dcce1286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.634157 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56a3f7798474e458c47e5471148680d', 'request_id': 'req-06a4c64d-8c44-4160-b903-0d95dcce1286'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.644851 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] The token cache is being invalidate because project b56a3f7798474e458c47e5471148680d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:19:22.645067 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.645686 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.647207 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1435/2891] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:19:22 2022] DELETE /identity/v3/projects/b56a3f7798474e458c47e5471148680d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:19:22.653429 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:22.655696 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:22.669599 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5043-f86a-4ce8-9053-f0a6c423bbc7 admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:22.727640 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:22.728531 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:22.728816 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:22.729089 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] PATH_INFO: `/v3/users/63ff223f75234ef8adf3b5708576a538` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:22.730293 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ff223f75234ef8adf3b5708576a538)` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:22.732246 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:22.928077 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ff223f75234ef8adf3b5708576a538'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.928679 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ff223f75234ef8adf3b5708576a538'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:22.929270 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ff223f75234ef8adf3b5708576a538'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.005965 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ff223f75234ef8adf3b5708576a538'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.017835 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.notifications [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ff223f75234ef8adf3b5708576a538'} {{(pid=79575) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.029602 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1457/2892] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Feb 28 13:19:22 2022] DELETE /identity/v3/users/63ff223f75234ef8adf3b5708576a538 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:19:23.293515 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Authenticating user token {{(pid=79576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:19:23.295045 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.fernet_utils [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:19:23.308002 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4c64d-8c44-4160-b903-0d95dcce1286 admin admin] Validating token access rules against request {{(pid=79576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:19:23.364296 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed54666ec9a44289bd042f58137716cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a00bab95afbd472db33af396a6aecd67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:19:23.365148 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:19:23.365432 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:19:23.365712 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] PATH_INFO: `/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4` {{(pid=79576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:19:23.366876 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb61bd6c27ed4551abd043d9c1f1c1d4)` {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:19:23.368848 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] RBAC: Authorization granted {{(pid=79576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:19:23.468166 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb61bd6c27ed4551abd043d9c1f1c1d4', 'request_id': 'req-b48371a8-c5c4-47ed-999a-910b90b35e6d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.531350 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb61bd6c27ed4551abd043d9c1f1c1d4', 'request_id': 'req-b48371a8-c5c4-47ed-999a-910b90b35e6d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.536958 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb61bd6c27ed4551abd043d9c1f1c1d4', 'request_id': 'req-b48371a8-c5c4-47ed-999a-910b90b35e6d'} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.547783 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] The token cache is being invalidate because project fb61bd6c27ed4551abd043d9c1f1c1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 13:19:23.548066 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.548689 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: DEBUG keystone.notifications [None req-b48371a8-c5c4-47ed-999a-910b90b35e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 13:19:23.550211 dv-cinder-831202-1-iscsi devstack@keystone.service[79576]: [pid: 79576|app: 0|req: 1436/2893] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Feb 28 13:19:23 2022] DELETE /identity/v3/projects/fb61bd6c27ed4551abd043d9c1f1c1d4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 13:21:33.033359 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Authenticating user token {{(pid=79575) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 13:21:33.034735 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:21:33.100801 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c9bda-daec-4b65-8e4b-4962abc29d7b admin admin] Validating token access rules against request {{(pid=79575) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 13:21:33.159067 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f16bdb11e5491aaadf0946b50a1e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd359df6fe00648978fe21b0dce4ecfe8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79575) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 13:21:33.159753 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] REQUEST_METHOD: `GET` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 13:21:33.160042 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] SCRIPT_NAME: `/identity` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 13:21:33.160576 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79575) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 13:21:33.162340 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.fernet_utils [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79575) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 13:21:33.174015 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 13:21:33.175635 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d670e4e-8be3-4371-879e-7ea5301e9b9b service placement] RBAC: Authorization granted {{(pid=79575) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 13:21:33.185338 dv-cinder-831202-1-iscsi devstack@keystone.service[79575]: [pid: 79575|app: 0|req: 1458/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Feb 28 13:21:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)